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The primary goal of this thesis is to design, develop and test an internet based prototype 
model for using expert system and software agent technologies to automate some of the 
analytical tasks in conducting aviation safety assessments using the data collected by the 
automated Aviation Command Safety Assessment (ACSA) system. 

The Aviation Command Safety Assessment is a questionnaire survey methodology 
developed to evaluate a Naval Aviation Command’s safety climate, culture, and safety program 
effectiveness. The survey was a manual process first administered in the fall of 1996. The survey 
was then automated in 1999 and is administered over the World Wide Web. 

The results of this thesis are a prototype model and a software agent application that 
evaluates data contained in the ACSA database for organizational safety assessment and for 
database integrity. All source code is provided and discussed in detail. 



V 



VI 



TABLE OF CONTENTS 



I. INTRODUCTION 1 

A. PURPOSE 1 

B. BACKGROUND 1 

C. THESIS ORGANIZATION 4 

D. PRODUCTS 4 

II. THE AVIATION COMMAND SAFETY ASSESSMENT SURVEY 7 

A. BACKGROUND 7 

7. Organizational Safety Effectiveness Model 7 

2. The ACSA Survey Questionnaire 8 

B. THE ACSA SURVEY SYSTEM ON THE WORLD WIDE WEB 1 1 

C. TECHNICAL DISCUSSION 12 

7. Database Design and Implementation 72 

2. Website Implementation 75 

III. DATABASE DESIGN 17 

A. INTRODUCTION 17 

B. INTEGRITY CONSTRAINTS IN DATA MODELING 17 

C. ACSA DATABASE WEAKNESSES AND PROBLEMS 18 

7. Corrupted Data 18 

2, Inflexibility 79 

3, Ambiguous Data 79 

4, Examples of Database Anomalies 20 

. D. REQUIREMENTS FOR A NEW DATABASE 20 

7. Problem Statement 27 

2. Confidentiality and Anonymity Constraints 22 

3. Respondent Information 22 

4. Survey Questions and Answers 23 

5. Squadrons 23 

6. Questionnaires 24 

7. Flexibility 24 

E. CONCEPTUAL DESIGN 25 

F. LOGICAL DESIGN AND TABLE SCHEMATA 26 

G. DATABASE DESIGNED FOR FLEXIBILITY 28 

H. OTHER DEVELOPMENT ISSUES 28 

IV. EXPERT SYSTEMS 31 

A. INTRODUCTION 31 

B . FUNDAMENTAL CONCEPTS 32 

7. Experts 32 

2. Expert Knowledge 32 

3. Knowledge Base 33 

4. Knowledge Representation 33 

5. Knowledge Engineering 34 

6. Inference Engine 34 

C. KNOWLEDGE ENGINEERING 34 

L Acquisition 34 

2. Validation and Verification 35 

3. Representation and Inference 35 



D. KNOWLEDGE REPRESENTATION 35 

1. Logic 36 

2. Semantic Networks 38 

3. Production Rules 39 

4. Frames 40 

E. REASONING METHODS 40 

1. Rule-based Inferencing 41 

2. Inference Trees 42 

3. Frame-based Inferencing 43 

4. Model-based Inferencing 44 

5. Case-based Inferencing 44 

6. Reasoning With Uncertainty 45 

F. THE JAVA EXPERT S YSTEM SHELL (JESS) 46 

G. THE ACS A SAFETY AGENT AND JESS 48 

1. Installing Jess 48 

2. Writing Jess scripts 48 

3. Using Jess with Java 49 

V. SOFTWARE AGENTS 51 

A. INTRODUCTION 51 

B. WHAT ARE SOFTWARE AGENTS? 51 

1. Agency 52 

2. Intelligence 52 

3. Mobility 53 

C. WHY USE AN INTELLIGENT AGENT? 53 

D. DIFHCULTIES IN BUILDING AN INTELLIGENT AGENT 54 

E. AGENTS IN USE TODAY 55 

1. Personal Applications 55 

2. Business Applications 56 

3. Telecommunications 57 

4. Expert systems { specialized knowledge-based applications) 58 

5. Computer Diagnostics 59 

6. Network Systems Management and Monitoring 60 

7. E-mail Filtering and Sorting 61 

F. AGENT TECHNOLOGIES 62 

1. Programming Languages 62 

2. Intelligent Reasoning 62 

3. Communications 63 

G. AGENT SOFTWARE PACKAGES AND VENDORS 63 

L Agent Builder by Reticular Systems, Inc 64 

2. Agentx by International Knowledge Systems 64 

3. Microsoft Agent by Microsoft Corporation 65 

4. Bee-gent by Toshiba Corporation 66 

5. Cable by Logica Corporation 66 

6. JATLite developed at Stanford University 67 

7. JATLiteBean developed at University of Otago 67 

8. Process Link developed at Stanford University 67 

VI. DEVELOPMENT OF THE ACSA SAFETY AGENT 69 

A. INTRODUCTION 69 

B . SOFTWARE DEVELOPMENT PROCESS 70 

1. Requirements Analysis 71 

2. Design Specification 76 

3. Implementation 77 

C AGENT MODEL 78 

viii 



/. Inference Engine 79 

2. Data Services 80 

3. Communications Services 80 

4. User Interface 81 

D. SAFETY AGENT PACKAGE 81 

1. Safety Agent (safety Agent. Safety A gent) 81 

2. Inference Engine ( safety Agent.InferenceEngine) 81 

3. Data Module (safetyAgent.data.DbModule) 83 

4. Questions and Safety A reas ( safetyAgent. Question and safety Agent. Safety A rea ) 84 

5. User Interface Package ( safetyAgent. uL*) 85 

E. SAFETY AGENT APPLICATION 85 

1 . Safety Agent App ( safetyAgent. agent App. SafetyAgentApp ) 86 

2. Application Frame (safety A gent, agent App. App Frame) 86 

3. Data Module (safetyAgent.agentApp.DbModule_Survey3_DB) 87 

4. Database 87 

5. Rules 88 

6. Reports 89 

F. INSTALLATION AND OPERATION 89 

1. Installation 89 

2. Operation 91 

G. ANALYSIS MODELS AND REPORTS 92 

1. Safety Assessment Model Implementation 93 

2. Database Integrity Model Implementation 95 

3. Explanation of Summary Reports 96 

H. WEAKNESSES OF THE SAFETY AGENT PACKAGE 97 

I. AREAS FOR FUTURE RESEARCH 98 

1. Knowledge Engineering 98 

2. Agent Technology 98 

3. Applications Development 98 

LIST OF REFERENCES 101 

APPENDIX A. AGENT MODEL SOURCE CODE 103 

APPENDIX B. SAFETY AGENT APPLICATION SOURCE CODE 121 

APPENDIX C. JESS RULE FILE 135 

APPENDIX D. DATABASE SQL DDL 143 

INITIAL DISTRIBUTION LIST 147 



IX 




X 



I. INTRODUCTION 



A. PURPOSE 

The purpose of this thesis is to develop a prototype software system that will 
assist in the analysis and maintenance of the Aviation Command Safety Assessment 
database, which is maintained at the Naval Postgraduate School in Monterey, California. 
The database contains answers and respondent information from Aviation Command 
Safety Assessment (ACSA) surveys, which are administered over the World Wide Web. 
The goal of this thesis is to design, implement, test, and analyze a simple model that uses 
automated reasoning and software agent technologies to assist aviation safety researchers 
in recognizing patterns and identifying anomalies in the database. The secondary goal of 
the thesis is to develop the system using internet technologies, such as, Java, JDBC, 
Hypertext Transfer Protocol (HTTP), JavaScript, Active Server Pages (ASP), Java 
Servlets, Transmission Control Protocol (TCP), Internet Protocol (IP), and Hypertext 
Markup Language (HTML). 

B. BACKGROUND 

The United States Navy aircraft loss rate has steadily declined over the past 
twenty years from ten aircraft losses per 100,000 flight hours to a current level of 
approximately two aircraft losses for every 100,000 flight hours. Despite this decline, the 
number of aircraft losses due to human error has remained relatively constant. 

About 60 percent of naval aircraft mishaps that cause death, permanent disability, 
or over one million dollars in losses are caused by aircrew errors. Aircrew errors, 
however, are often not isolated to just the crew involved. Mishaps usually involve a 
chain of events, many of which, begin at the organizational level. In 1996, the 
Commander Naval Air Pacific chartered a Human Factors Quality Management Board 
(QMB), which recognized that a squadron’s safety climate was a critical link in the 
mishap chain of events. The board appointed Dr. Anthony Ciavarelli of the Naval 
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Postgraduate Safety School as the principal investigator for measuring command safety 
climate throughout naval aviation. 

Dr. Ciavarelli and his research team (LTCOL Robert Figlock, USMC, Dr. 
Karlene Roberts and her associates from UC Berkeley and UCLA) developed the 
Aviation Command Safety Assessment (ACSA) survey to evaluate the effectiveness of a 
command’s safety climate, culture, and safety program. The ACSA has been automated 
and is administered as a web application over the public Internet. The automated ACSA 
has enabled the QMB to quickly and efficiently survey and simultaneously evaluate 
communities throughout naval aviation. 

The automated ACSA Survey System is accessible on the public internet as 
shown in Figure 1 and Figure 2. The website enables survey respondents to answer 
survey questions from anywhere in the world. Respondents answer survey questions 
with responses that range from from strongly disagree to strongly agree. 
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Figure 2: ACSA Survey Form 



Respondent answers and some demographic data concerning the respondent are 
then stored in a relational database management system (RDBMS), Microsoft SQL 
Server 7.0, located at the Naval Postgraduate School. 

This thesis takes the automated ACSA system one step further by developing an 
automated tool for data retrieval, analysis, and action. Artificial intelligence, expert 
system, database, and internet technologies are available for developing software agents 
that can automatically query data from the database, find patterns, match the patterns to 
rules generated by the human subject matter expert, and then execute an action as 
specified by the user. Actions could include printing a report, sending an email 
notification, or displaying an alert message on the screen. 

Additional development of the ACSA system includes improving the web 
application that administers the survey. The original system uses a database design that 
is inherently inflexible and susceptible to corruption. This thesis designs, tests, and 
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implements a new database design that corrects many of the database problems of the 
original design. The new design also dramatically extends the capabilities of the system 
for administering the survey and for conducting research. A commercial internet 
applications developer, Universal Internet, Inc., has begun upgrading the automated 
ACSA survey system for the Naval Postgraduate School. The new database design sits 
as the core information system of the new ACSA web site. Chapter HI of this thesis 
discusses the new database design. 

C. THESIS ORGANIZATION 

This thesis is organized into the following chapters: 

• Chapter I: Introduction . This chapter provides an introduction for the thesis 
and the reason for research in the specific topic area. 

• Chapter II: ACSA . This chapter describes the ACSA survey in more detail, 
and it explains the rationale and the model, upon which, the survey was 
constructed. The chapter also covers the technical aspects of the automated 
ACSA Survey System, as it was originally developed. 

• Chapter HI: Database Design . Core to any information system is its database, 
and this chapter explains our redesign of the ACSA database and its 
ramifications. 

• Chapter IV: Expert Systems. This chapter provides a broad discussion of the 
current issues and technology concerning expert systems. 

• Chapter V: Software Agents This chapter discusses the current technologies 
and applications of software agents. 

• Chapter VI: The Design and Operation of the ACSA Agent. This chapter 
provides a detailed explanation of the development, design, analysis, and 
implementation of the software system. 



D. PRODUCTS 

The final products of this thesis include a model for developing automated 
software assistants and an application that demonstrates how the model may be used. 
The application, which is called the ACSA Safety Agent, runs as a Java application and 
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can connect to the ACSA database over a network. The application creates a software 
agent that periodically analyzes the database and produces reports on its findings. The 
agent produces five organizational safety assessments and three database integrity 
checks. The assessments and integrity analysis are summarized into two different 
reports, which may be automatically emailed to the user, saved to disk, displayed on the 
screen, or sent to a printer for printing. Chapter VI discusses the model and the 
application in further detail. 
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II. THE AVIATION COMMAND SAFETY ASSESSMENT 

SURVEY 



A. BACKGROUND 

1. Organizational Safety Effectiveness Model 

Accidents are not always simply the result of errors made by a pilot, a co-pilot, a 
navigator, or an aircraft mechanic. The so-called "human error" accident is often the 
tragic conclusion of a list of antecedents that are not necessarily in the hands of the 
system operator or maintainer. Accident causation often includes the linkage between 
both active failures (those that are caused by the operator or maintainer) and latent 
failures (those that are caused by organizational strategies). One approach to preventing 
active failures is to develop a system that identifies latent failures, which can ultimately 
lead to an active failure. The Organizational Safety Effectiveness Model identifies the 
characteristics and functions of an organization that are related to an organization’s safety 
effectiveness. The model and the Aviation Command Safety Assessment (ACSA) 
Survey were developed to provide diagnostic data about an organization’s risk for 
accidents. 

Dr. Ciavarelli and Robert Figlock, both from the Naval Postgraduate School, 
developed the following conceptual framework, which was adapted from a model 
developed by Dr. Carolyn Libuser from UCLA and by Dr. Karlene Roberts from the 
Haas Business School, UC Berkeley. The model includes five categories related to 
organizational safety effectiveness: 

• Process Auditing - A system of ongoing checks to identify hazards and to 
correct safety problems. 

• Reward System - The expected social rewards and disciplinary actions used 
to reinforce safe behavior and to correct unsafe behavior. 

• Quality Control - The policies and the procedures for promoting high quality 
of work performance. 
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• Risk Management - A systematic process used to identify haztirds and to 
control operational risks. Includes accurate risk assessments. 

• Command and Control - Reflects the organization’s overall safety climate, 
leadership effectiveness, and the policies and procedures used in the 
management of flight operations and safety. 

2. The ACS A Survey Questionnaire 

Questions were developed to elicit measurable data concerning the five safety 
effectiveness model areas. Statistical tests were conducted to obtain measurement 
reliability of the survey questionnaire and to determine the factorial composition of the 
survey questionnaire. The analyses indicated an average reliability value of 0.80 across 
the five safety effectiveness model areas. The survey questions are answered according 
to a Likert scale: strongly disagree, moderately disagree, somewhat disagree, neutral, 
somewhat agree, moderately agree, strongly agree, and not applicable. The questions are 
described in Table 1. 

An earlier version of the survey was administered in 1996 by mail to 69 randomly 
selected navy and marine squadrons. Since that time, however, an updated version of the 
survey has been automated and is accessible via the World Wide Web. 



Table 1: ACSA Survey Questions 



Process Auditing 


No. 


Question Text 


1 


My command conducts adequate reviews and updates of safety standards and 
operating procedures. 


2 


My command uses an internal audit and hazard reporting system to catch any 
problems that may lead to a mishap. 


3 


My command has a defined process to set training goals and to review 
performance. 


4 


My command closely monitors proficiency and currency standards to ensure 
aircrew are qualified to fly. 


5 


Command leadership is actively involved in the safety program and the 
management 
of safety matters. 


6 


My command has a defined process to effectively manage the high-risk aviator. 


7 


Human Factors Councils have been successful in identifying aircrew members 
who pose a risk to safety. 
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8 


Human Factors Boards have been successful in reducing chances of an aircraft 
mishap due to the high-risk aviator. 


9 


My command makes effective use of the flight surgeon to help identify and 
manage high-risk personnel. 


Reward System and Safety Culture 


10 


Command leadership encourages reporting safety discrepancies without the fear 
of negative repercussions. 


11 


Individuals in my command are willing to report safety violations, unsafe 
behaviors, or hazardous conditions. 


12 


In my command, peer influence is effective at discouraging violations of standard 
operating procedures, or safety rules. 


13 


In my command, we believe safety is an integral part of flight operations. 


14 


In my command, anyone who intentionally violates standard procedures, or safety 
rules, is swiftly corrected. 


15 


In my command, violations of operating procedures, flying regulations, or general 
flight discipline are rare. 


16 


Leaders in my command encourage everyone to be safety conscious and to follow 
the rules. 


17 


In my command, an aviator who persistently violates flight standards and rules 
will seriously jeopardize his/her career. 


18 


I am not comfortable reporting a safety violation because people in my command 
would react negatively toward me. 


Quality 


19 


My command has a reputation for high quality performance. 


20 


My command sets high quality standards and strives to maintain quality control. 


21 


My command closely monitors quality and corrects any deviations from 
established quality standards. 


22 


Quality standards in my command are clearly stated in formal publications and 
procedural guides. 


Risk Management 


23 


Command leaders permit cutting comers to get a job done. 


24 


Lack of experienced personnel has adversely affected my command’s ability to 
operate safely. 


25 


Safety decisions are made at the proper levels, by the most qualified people in my 
command. 


26 


Command leaders consider safety issues during the formation and execution of 
operational and training plans. 


27 


Command leadership has a clear picture of the risks associated with its flight 
operations. 
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28 


My command takes the time to identify and assess risks associated with its flight 
operations. 


29 


My command does a good job managing risks associated with its flight 
operations. 


30 


My command has increased the chances of a mishap due to inadequate or 
incorrect risk assessment. 


31 


I am provided adequate resources (time, staffing, budget, and equipment) to 
accomplish my job. 


32 


My command provides the right number of flight hours per month for me to fly 
safely. 


33 


I have adequate time to prepare for my brief and flight. 


34 


Based upon my command’s personnel and other assets, the command is over- 
committed. 


35 


My command has incorporated Operational Risk Management processes in 
decision making at all levels. 


Command and Control 


36 


My supervisor can be relied on to keep his/her word. 


37 


Our command leaders and supervisors can be trusted. 


38 


My command’s Safety Officer is highly regarded. 


. 39 


Our Safety Officer is influential in promoting safety. 


40 


My command is genuinely concerned about safety. 


41 


Command leadership is successful in communicating its safety goals to unit 
personnel. 


42 


My command provides a positive command climate that promotes safe flight 
operations. 


43 


Command leadership is actively involved in the safety program and management 
of safety matters. 


44 


Command leadership sets the example for compliance with flight standards. 


45 


My command ensures that all unit members are responsible and accountable for 
safe flight operations. 


46 


Command leadership willingly assists in providing advice concerning safety 
matters. 


47 


Command leadership reacts well to unexpected changes to its plans. 


48 


My command does not hesitate to temporarily restrict from flying individuals who 
are under high personal stress. 


49 


I am adequately trained to safely conduct all of my flights. 


50 


Morale and motivation in my command are high. 
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51 


My command ensures the uniform enforcement of all operating standards among 
unit members. 


52 


Crew rest and standards are enforced at my command. 


53 


In my command, NATOPS test and check rides are conducted as intended, to 
candidly assess aircrew qualifications. 


54 


My command provides adequate safety backups to catch possible human errors 
during high-risk missions. 


55 


Within my command, good communications flow exists up and down the chain of 
command. 


56 


My command has good two-way communication with external commands. 


57 


Safety education and training are adequate in my command. 


58 


The Safety Department is a well-respected element of my command. 


59 


The Aviation Safety Officer position is a sought-after billet in my command. 


60 


My command’s Safety Department keeps me well informed regarding important 
safety information. 


61 


My command’s Aircrew Coordination Training Program is helping to improve 
mission performance and safety. 



B. THE ACSA SURVEY SYSTEM ON THE WORLD WIDE WEB 

In 1999, Fred Mingo and John Held, who were graduate students at the Naval 
Postgraduate School, developed and implemented the automated ACSA Survey System. 
The system consists of a password-protected website, a backend database, and a survey 
number assignment and validation application. The website, as shown in Figure 1, is 
located at http://spitfire.avsafety.nps.navy.mil. Users, who have a valid user ID and 
password, can access three basic applications from the ACSA website: 



• Survey Number and Squadron ID Administration - The system 
administrator uses this application to assign squadron identification numbers 
and to assign valid survey numbers to squadrons. The data is entered into a 
database, which is checked later for valid survey numbers and squadron IDs 
whenever a respondent attempts to submit a completed survey via the 
automated ACSA Survey System. Access to this application requires an 
additional password for system administrators only. 



11 



• The Automated ACSA Survey System - After a squadron’s aviation safety 
officer (ASO) has contacted the Aviation Safety School at the Naval 
Postgraduate School, and has requested that the survey be administered to his 
or her squadron, the system administrator gives the ASO a unique squadron 
ID and a block of valid survey numbers. The ASO then administers the 
survey to his or her squadron by distributing the survey numbers to the 
members of the squadron. Squadron members then may go to the ACSA 
website and complete the survey. The system will only accept a completed 
survey if the respondent enters a valid squadron ID coupled with a valid 
survey number. The data is then stored in a relational database system, 
Microsoft SQL Server 7.0, at the Naval Postgraduate School. Survey 
responses are kept completely anonymously and cannot be associated to a 
respondent. 

• The Commander’s Module - Only squadron commanders can access this 
application. The Commander’s Module provides the commander with 
comparative charts, which graphically display average results by question by 
community, service, and location. 

C. TECHNICAL DISCUSSION 



1. Database Design and Implementation 

Developers designed the ACSA database to model the original pen and ink survey 
form, which resulted in a relational database schema that is only in first normal form 
(INF). The entity relation diagram is displayed in Figure 3, and the schema is explained 
in Table 2 and Table 3. The inherent weaknesses of the database design will be discussed 
in the next chapter. Chapter HI: Database Design and Implementation. This section will 
present the details of the design and implementation only. 
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Figure 3: ER Diagram for Original Database 
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Table 2: Biographical_Data Table Schema 



Field Name 


Type 


Table Constraints 


Community 


VARCHAR(50) 


Primary Key 


Squadron_Number 


INTEGER 


Primary Key 


Survey_Number 


INTEGER 


Primary Key 


Rank 


INTEGER 




Designator 


VARCHAR(50) 




Flight_Hours 


INTEGER 




Type_Hours 


INTEGER 




Dept_Head 


VARCHAR(50) 




Status 


VARCHAR(50) 




Service 


VARCHAR(50) 




Location 


VARCHAR(50) 




Bio_Date 


VARCHAR(50) 





Table 3: Questions Table Schema 



Field Name 


Type 


Table Constraints 


Community 


VARCHAR(50) 


Primary Key 


Squadron_Number 


INTEGER 


Primary Key 


Survey_Number 


INTEGER 


Primary Key 


Ql 


INTEGER 




Q2 


INTEGER 




Q3 


INTEGER 




Q4...Q60 


INTEGER 




Q6I 


INTEGER 





Developers implemented the database in Microsoft Access and then used an 
Access add-in to automatically migrate the database to SQL Server 6.5. The DBMS has 
since been upgraded to SQL Server 7.0. 

An additional database was created for tracking valid survey numbers. The 
Num_List_DB database contains one table called Num_List_DB, and its schema is 
shown in Table 4. The system administrator uses Num_List_DB for assigning a block of 
numbers to a Squadron_ID. The Squadron_ID is a concatenation of values from the 
domain for Community and the domain for Squadron_Number. For example, a Unit_ID 
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HMM902 is eventually entered by a respondent into the Community field (HMM) and 
the Squadron_Number field (902) of the ACSA Survey form. The system then inserts the 
two fields into the ACSA database tables when the respondent completes the survey. 
When a user submits a survey, the system checks to ensure that the respondent’s 
Survey_Number is within the block of integers designated by the Start_Number and 
End_Number fields in the Num_List_DB table. 



Table 4: The Num_List_DB Schema 



Field Name 


Type 


Table Constraints 


Unit_ID 


VARCHAR(50) 




Start_Number 


INTEGER 




End_Number 


INTEGER 





2. Website Implementation 

As explained earlier in Chapter II, Section B, the website offers three 
applications: the ACSA Survey, the Administrator Tool, and the Commander’s Module. 
The website, the databases, and the applications are hosted on a 200MHz Pentium PC 
running NT Server and Microsoft Internet Information Server (IIS). The applications use 
a mix of programming languages and web application methodologies. 

The ACSA Survey runs both as a Java applet and as an HTML form-based 
application. The applet is rarely used, so we will not discuss its implementation. It uses 
Java 2, which requires an initial download of the Java 1.2 Plugin. Instead, users prefer to 
use the HTML form-based application. The survey application uses HTML and Javasript 
for data entry and validation on the front-end. The survey submits its data to a Java 
servlet, which is running on the same server as the web server. The servlet connects to 
the database and enters the data into the ACSA database via Java JDBC. 

The Administrator Tool runs as an Active Server Page (ASP) application, which 
offers a webpage front-end form for entering and querying data in the Num_List_DB 
database. The Commander’s Module is an applet that connects to the database via Java 
JDBC. 
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III. DATABASE DESIGN 



A. INTRODUCTION 

System developers used the pen and ink survey form as a model for developing 
the original ACSA database. While effective in providing a persistent storage medium for 
form data, the database design methodology that the developers followed did not produce 
a database that adheres to relational database theory. Therefore, the relational database 
management system (RDBMS) cannot reliably apply relational algebra operations and 
relational calculus to the database. The database also does not prevent insertion and 
deletion anomalies, since the database is not normalized. Effectively, the original 
database is unreliable and inflexible. Such weaknesses would need to be eliminated in 
order to successfully develop an intelligent software agent for database analysis. This 
chapter will explain how the database was re-designed to support current and future 
applications. First, this chapter briefly introduces the concept of enforcing business rules 
in database design. Second, this chapter discusses the weaknesses and problems of the 
current database. Finally, this chapter discusses the database design process that was 
followed in order to produce a new database that eliminates or mitigates the problems of 
the current database. 

B. INTEGRITY CONSTRAINTS IN DATA MODELING 

A database stores information about some part of the real world, which is called 
the miniworld or the universe of discourse. Rules, which are called business mles or 
integrity constraints, govern the universe of discourse. Business rules include domain 
constraints, key constraints, relationship constraints, and general semantic integrity 
constraints. When designing a database, the developer must identify the business rules 
that the database must enforce. The developer should specify as many of these rules as 
possible to the RDBMS and make the RDBMS responsible for enforcing them. [Ref. 1] 
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c. 



ACSA DATABASE WEAKNESSES AND PROBLEMS 



1. Corrupted Data 

The RDBMS enforces virtually none of the business rules governing the ACSA 
database. For example, the Automated ACSA Survey System depends upon at least three 
separate databases, between which, the RDBMS enforces no relational constraints. 
Survey answers and respondent data are maintained in one database, squadron numbers 
and survey IDs are maintained in another database, and CO passwords are maintained in 
a third database. The RDBMS enforces no relationships between these databases; 
although, relationships obviously do exist between several of the entities. For example, a 
survey ID has a relationship to a respondent, because respondents are given access to the 
survey site via their assigned survey ID number. The database, however, neither 
expresses nor enforces the relationship. The relationship is enforced by the application 
software, instead. In fact, the system relies almost solely upon the application software 
that runs the Automated ACSA Survey System to enforce all business rules, including, 
domain constraints. 

Many functional dependencies are also enforced at the application level instead of 
at the database management level; while, in other cases, functional dependencies are 
totally ignored. For example, the respondent’s survey ID functionally determines his or 
her squadron number and community. This functional dependency is expressed as survey 
ID squadron number, community. The RDBMS does not enforce either of these 
functional dependencies. Instead, the application enforces survey ID squadron 
number, while survey ID —> community is not enforced at all. 

The placement of virtually all business rules at the application level has resulted 
in a database that can inadvertently be corrupted if the database is accessed from an 
access point other than the application that enforces the rules. For example, a user may 
access the database from the database’s own user interface or from another application 
that doesn’t enforce the rules. The RDBMS provides little protection in preserving the 
meaning of the data under the original design. Therefore, an intelligent software agent 
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cannot rely upon the information contained within the original ACSA database. In fact, 
the database exhibits signs of corruption, which are discussed further below. 

2. Inflexibility 

Another major problem of the current ACSA database concerns inflexibility. The 
current design does not allow users to add, remove, or modify survey questions without 
risking loss of information. Such changes also require significant changes to the current 
Automated ACSA Survey System application software. This is caused by the fact that 
the database does not contain any information about a question as an entity in its own 
right. The database only contains information about the answers. 

3. Ambiguous Data 

The intelligent software agent must transform individual data cells, aggregate 
data, and data patterns into meaningful information, so that the agent can make 
conclusions based upon a set of rules and explicit and inferred facts contained in the 
database. The current design hinders the safety agent in two ways. First, null values are 
allowed in all fields, other than the primary key fields. From a database design and 
administration point of view, allowing null fields is often a pragmatic design decision. 
The information may not be known when a record is entered into the database, or the data 
is not critical to operations but is kept for secondary reasons. Null values, however, 
should be avoided when possible, because null values can lead to problems with 
understanding the meaning of the attributes and when specifying join operations at the 
logical level [Ref. 1]. In the case of the ACSA survey, no pragmatic reason exists for 
allowing null values in any field of the database. Therefore, nulls should not be allowed 
whatsoever. Missing information will degrade the overall effectiveness of the intelligent 
agent and result in inferior conclusions, unless the agent can ascertain why the 
information is missing. A null value can mean either that the field does not apply to this 
record, or that the value for the field is unknown, or that the value is known but is absent. 
Which of the three meanings is correct is anybody’s guess. 

Another problem concerning ambiguous data has been caused by the survey itself 
and has no relation to the database design. It is mentioned here briefly since it is related 
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to ambiguous data. One of the possible answers to any survey question is "NA." 
Respondents have been using "NA" to mean "I do not know", "I don’t understand the 
question", "This question is not applicable to me", or "This question is not applicable to 
my unit." The survey designers have taken steps recently to refine the answer scale on 
the survey to be more specific. 

4. Examples of Database Anomalies 

The following database anomalies were found after thoroughly reviewing the 
original database: 

• Six records in the Biographical_Data table do not contain values for 
"Designator" and "Dept_Head". These fields should not be empty, since they 
both apply to all respondents and since the application enforces rules that are 
supposed to prevent blank respondent fields from being entered into the 
database. 

• Two of the eleven records for Squadron HMM924 indicate "Other" as their 
location. The other nine records indicate "West Coast." This is a result of the 
functional dependency survey ID — > community not being enforced by the 
RDBMS. 

• There are four records in the Biographical_Data table, for which, no 
corresponding records in the Questions table exist. The database either 
contains records for people who never took the survey or contains records for 
people whose survey answers have been deleted. No conclusion can be drawn 
from this information. Furthermore, the application software supposedly 
would not allow this difference between table records to occur. Also, since the 
database was modeled after the survey form, it appears that something is 
amiss if the Biographical_Data and Questions tables contain unequal numbers 
of records. 

D. REQUIREMENTS FOR A NEW DATABASE 

With the inherent weaknesses of the original database exposed, it became 
necessary in the development of the intelligent agent to re-design the database and 
populate the new database with valid information from the original database. The design 
process followed a complete database design process, which included requirements 
collection and analysis, conceptual database design, logical database design, and physical 
database design. Furthermore, the design was presented to commercial contractors, who 



20 



are currently developing a production-level Automated ACSA Survey System for the 
Naval Postgraduate School, for their review and design consideration. The first step in 
the design process was to make a list of requirements for the new database design. 
Below is the list of all the requirements that were to be addressed during the development 
of the new database. 

1. Problem Statement 

Requirements analysis began with the development a problem statement that 
describes the system’s data requirements plain text English; 

The Naval Postgraduate School administers the Aviation Safety 
Command Assessment Survey via the World Wide Web. Respondent 
biographical data and survey answers are stored electronically in a 
relational database after the respondent has completed all fields of the 
survey, has selected the submit button, and has entered a valid survey 
identification number. The database must support the following use case 
and data requirements; 

Squadrons are assigned a block of survey IDs. Survey IDs are then 
distributed to squadron members who then complete the ACSA Survey 
on-line using their Squadron ID and Survey ID as validation. Squadrons 
may or may not use all of their assigned survey IDs. A respondent may 
only fill out the survey once using a Squadron ID and Survey ID pair. 

After the respondent completes the survey, the Survey ED for that 
squadron is no longer valid. ACSA administrators can add or remove 
questions at any time. If a question is deleted, then all of the answers for 
that question are deleted. If a question ED is changed, then all the answers 
to that question will reflect the new question ID. ACSA Administrators 
will be able to maintain multiple versions of the questionnaire in the 
database, and they will be able to track the answers to a question by 
questionnaire version. If a squadron is deleted from the database, then all 
Survey IDs, respondent information, and answers related to that squadron 
are deleted from the database. Squadrons must have a community and a 
location. Respondents must submit data for all biographical fields. The 
date (month, day, year) that the respondent completed the survey will be 
recorded. The database may only contain respondent information and 
survey answers that belong to a valid Survey ID. ACSA administrators 
must be able to view the database longitudinally by the respondent’s data, 
by squadrons, by community, by location, by date, by question, and by 
questionnaire version. 
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2. Confldentiality and Anonymity Constraints 



One of the goals for the ACSA survey system is to ensure that respondents and 
squadrons do not feel that the system is being used for evaluation purposes, but rather, it 
is strictly being used as a tool for identifying possible safety problems that could lead to 
aviation mishaps. As a result, the database design is constrained by the following 
requirements: 

• Respondents are guaranteed anonymity. 

• Squadrons are guaranteed confidentiality. 

3. Respondent Information 

In order for the agent to draw conclusions based on different geographical, as well 
as professional demographics, the database will collect and store the following data 
concerning respondents: 



Table 5: Respondent Data Requirements 



Data Name 


Description of the Data 


Rank 


Possible values are: "E1-E5", "E6-E9","0 1-03 ","04-06" 


Designator 


Possible values are: "NFO", "Pilot", "Aircrew" 


Flight Hours 


A number x, where x is the total number of flight hours for the 
respondent and 0 < x < 25,000 


Type Hours 


A number y, where y is the number of flight hours the 
respondent has for the type of aircraft he or she currently flies 
and 0 < y < X 


Squadron 


The squadron, to which, the respondent is assigned 


Status 


The respondent’s active duty / reserve status. Possible values are: 
"Regular", "Active Reserve", "Drilling Reserve" 


Service 


The respondent’s service component. Possible values are: 
"Navy", "USMC", "Other" 


Department Head? 


Is the respondent a department head? Yes or no. 


Date 


When did the respondent complete the survey? 


Aircraft Type 


What type of aircraft does the aviator fly? 
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4. Survey Questions and Answers 



In order to create the ability to change, add, and delete questions in a survey, it is 
necessary for the database to contain both the questions and the answers. This also 
provides for the ability of the software application to create objects dynamically, and 
allows for changes to the questions database without degrading database information 
integrity. The database must store the following information about survey answers: 



Table 6; Question And Answer Data Requirements 



Data Name 


Description of the Data 


Question Number 


A number x, where 1 < x < the number of survey questions 


Question Text 


The question 


Answer 


A number y, where y is an answer given by a respondent for 
question number x and -1 < y < 6 


Respondent 


Who does this answer belong to? 


Safety Area 


What organizational safety model area does this question belong 
to? Possible values are: "Process Auditing", "Reward System", 
"Quality", "Risk Management", "Organization and Control" 


Positive? 


Is the question positively worded, which means that to agree to the 
statement is a positive answer. 



5. Squadrons 

The database must store the following information about squadrons: 



Table 7: Squadron Data Requirements 



Data Name 


Description of the Data 


Squadron 

Identification 


The identification of the squadron 


Community 


The community, to which, the squadron belongs. Possible values 
are: "HC", "HCS", "HM", "HMH", "HMT","HS", "HSC", "HSL", 
"VAQ", "VAW", "VF", "VFA", "VMAQ", "VMFA", "VP", "VQ", 
"VR", "VRC", "VS", "VT", "VX", "Other" 
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Location 


The location of the squadron. Possible values are: "East Coast", 




"West Coast", and "Other" 



6. Questionnaires 

Users must be able to change the survey without crippling software applications 
that depend upon the database. Applications should be able to dynamically adjust to 
survey modifications. Therefore, the database should contain information that describes 
the survey. In particular, the database must store the following information about 
surveys: 



Table 8: Questionnaire Data Requirements 



Data Name 


Description of the Data 


Questionnaire 

Version 


The identification of the questionnaire 


Update Date 


When was the questionnaire version last updated 


Questions 


What questions belong to this questionnaire and what order are 
they in the questionnaire? 



7. Flexibility 

Aviation Safety School personnel can change survey questions, question numbers, 
and the order and grouping of questions. Such changes will not require fields to be added 
or removed to or from the database, and such changes will not require the database to be 
re-designed. This will also allow the database to archive old questions from older 
versions of questionnaires and their answers. Archiving the old questions and answers 
will provide good tools for future improvements to the intelligent agent, as well as ensure 
that database integrity remains intact despite new modifications. 

The database will support software development, so that that any software that 
depends upon the database for information will not need modification if questions are 
added, removed, or modified. 
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E. 



CONCEPTUAL DESIGN 



The first step in the conceptual design phase is to develop an entity-relation (ER) 
diagram that depicts the entity types, the attributes, and the relationships between the 
entity types. The ER diagram below represents the initial conceptual design that was 
developed during conceptual design phase of the database design process. Compare this 
ER diagram to the ER diagram in Chapter 2 that reflects the conceptual design of the 
original ACSA database. 
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F. 



LOGICAL DESIGN AND TABLE SCHEMATA 



The following table schemata and tables describe a logical design that maps the 
ER diagram to a relational design that is in Boyce-Codd normal form (BCNF): 

• Squadrons (Squadron ID . Community, Location) 

• Squadrons_Survey_IDs (Survey ID. Squadron ID^ 

• Respondents (Survey ID. Squadron ID . Date, Rank, Designator, Flight_Hours, 
Type_Hours, Dept_Head, Status, Service, Aircraft_Type) 

• Answers (Survey ID. Squadron ID. Question ID . Answer) 

• Questions (Question ID , Question_Text, Safety_Area, Is_Positive) 

• Questions_Questionnaires (Questionnaire Version, Question ID , 
Question_Number) 

• Questionnaires (Questionnaire Version . Last_Update) 



Table 9 : Squadrons Table Schema 



Field 


Type 


Constraints 


Squadron_ID 


INT 


Primary Key 


Community 


VARCHAR(25) 


Not null, cascade deletes 
and updates 


Location 


VARCHAR(25) 


Not null, cascade deletes 
and updates 



Table 10: Squadrons_Survey_IDs Table Schema 



Field 


Type 


Constraints 


Survey_ED 


INT 


Primary Key 


Squadron_ID 


INT 


Primary Key, references 
Squadrons 
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Table 11: Questionnaires Table Schema 



Field 


Type 


Constraints 


Questionnaire_Version 


INT 


Primary Key 


Last_Update 


DATE 


Not null 



Table 12: Questions Table Schema 



Field 


Type 


Constraints 


Question_ED 


INT 


Primary Key 


Question_Text 


VARCHAR(255) 


Not null 


Is_Positive 


BIT(l) 


Default B ’1 not null 


Safety_Area 


VARCHAR(50) 


Not null 



Table 13: Questions_Questionnaires Table Schema 



Field 


Type 


Constraints 


Questionnaire_Version 


INT 


Primary Key, references 
Questionnaires, cascade 
deletes and updates 


Question_ED 


INT 


Primary Key, references 
Questions, cascade deletes 
and updates 


Question_Number 


INT 


Not null 



Table 14: Respondents Table Schema 



Field 


Type 


Constraints 


Survey_ID 


INT 


Primary Key; references 
Squadrons_Survey_IDs, 
cascade deletes and updates 


Squadron_ID 


INT 


Primary Key; references 
Squadrons_Survey_IDs, 
cascade deletes and updates 


Date 


DATE 


Not null 


Rank 


VARCHAR(25) 


Not null 


Designator 


VARCHAR(25) 


Not null 


Flight_Hours 


INT 


Not null 



27 



Type_Hours 


INT 


Not null 


Dept_Head 


BIT(l) 


Default B ’1 not null 


Status 


VARCHAR(25) 


Not null 


Service 


VARCHAR(25) 


Not null 


Aircraft_Type 


VARCHAR(25) 


Not null 



Table 15: Answers Table Schema 



Field 


Type 


Constraints 


Survey_rD 


INT 


Primary Key, references 
Respondent, cascade deletes 
and updates 


Squadron_ID 


INT 


Primary Key, references 
Respondent, cascade deletes 
and updates 


Question_ID 


INT 


Primary Key, references 
Questions, cascade deletes 
and updates 


Answer 


INT 


-1 >= Answer <= 6, not null 



G. DATABASE DESIGNED FOR FLEXIBILITY 

One of the major goals in the development of this software intelligent agent was 
to have all components dynamically created from reading the database, taking current 
version questions and creating the graphic user interface for the intelligent agent. The 
addition of the questionnaire table allows for this to be easily implemented. The tables 
were arranged so that each respondent can have answers associated with the version of 
the questionnaire they took. What this means is there is no longer a requirement to 
redesign the database if a question needs to be added, deleted, or modified as in the 
original database design. 

H. OTHER DEVELOPMENT ISSUES 

It is important to note that in developing this new database design, that adhering 
strictly to the relational model was a priority. While not always the best approach when 

developing a database, it was essential to the design of this database primarily for the 
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reason that this database would not have a full-time administrator to manage the database. 
As a result, the database will get very minimal maintenance, so the RDBMS must be able 
to protect the integrity of the database via business rules that are explicitly specified in 
the database design. The trade-off for this strict adherence to the relational model has 
been at the cost of more difficult query development and longer query running time, due 
to larger number of inner joins required when completing a query. 

The database was designed using Microsoft Access 97 because of its ubiquitous 
presence, easy-to-use graphical interface, and compliance with the U.S. Navy’s IT-21 
policy. From that design, the database was populated with over 319 validated surveys 
from the original database to test the software intelligent agent. Once tested, the database 
design was defined in SQL-2 Data Definition Language (DDL), which is included in 
Appendix D. The Access database and the DDL were then provided to the commercial 
contractors who are building the production-level ACSA survey system for 
implementation in Microsoft SQL Server 7.0 within the NFS campus network domain. 
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IV. EXPERT SYSTEMS 



A. INTRODUCTION 

Dr. Edward Feigenbaum, Professor of Computer Science at Stanford University, 
describes an expert system as an intelligent computer program that uses knowledge and 
inference procedures to solve problems that are difficult enough to require significant 
human expertise for their solutions. An expert system, according to Dr. Feigenbaum’ s 
description, should emulate the decision-making ability of a human expert. An expert is a 
person who has expertise in a certain domain, and, like the human expert, the expert 
system's expertise would be limited to a certain domain. The terms "expert system", 
"knowledge-based system", and "knowledge-based expert system" are often used 
interchangeably. An abstract conceptual model of the expert system is presented in 
Figure 5. 
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Figure 5: Expert System Conceptual Model 



Expert systems are typically constructed from rules and facts, which are derived 
from domain knowledge and from expert knowledge. Rules model human problem 
solving, and facts are things that the system considers to be true. Rules and facts are 
collectively known as the knowledge base. An inference engine processes the rules and 
the facts to create new facts. An application that separates the knowledge base from the 
inference engine is known as a shell. The shell allows the knowledge base of a system to 

be changed as needed. Therefore, a unique inference engine does not need to be built for 
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every expert system. An expert system shell, like CLIPS or Jess, can be used in almost 
any expert system. 

B. FUNDAMENTAL CONCEPTS 

The following list briefly introduces the fundamental concepts of expert systems. 
The chapter discusses some of the concepts in more detail further below. 

1. Experts 

Experts are people who know how to solve complex problems within a particular 
domain. Experts know which facts are important. They understand the relationships 
between the facts and know how to make a plan to solve the problem. An expert typically 
exhibits the following characteristics: 

• Recognizes and formulates the problem 

• Solves the problem quickly and properly 

• Can explain the problem and the solution 

• Learns about the domain from experience 

• Restructures knowledge whenever needed 

• Knows when to break the rules 

• Degrades gracefully by knowing the limits of their expertise, but still manages 
to develop a reasonable solution 

An expert system would need to exhibit all of these characteristics to completely 
emulate the human expert. However, most expert systems exhibit only a subset of these 
characteristics. In general, most expert systems can solve a problem quickly and explain 
the solution. [Ref. 2] 

2. Expert Knowledge 

Expert knowledge is described as expertise in a specific domain that has been 
acquired over time from experience and training. Expertise includes the following types 
of knowledge: 

• Theories 
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• Rules and procedures 

• Heuristics 

• Global strategies for solving problems 

• Meta-knowledge 

• Facts 

Expert knowledge enables experts to make better and faster decisions than non- 
experts can when solving complex problems. [Ref. 2] 

3. Knowledge Base 

The knowledge base contains the facts and rules that the expert system will use to 
solve a problem. Facts and rules express the expert system’s knowledge. The knowledge 
base is typically organized and used by the expert system via a process called knowledge 
representation. 

4. Knowledge Representation 

Knowledge representation schemes organize the knowledge contained in the 
knowledge base in a manner that enables the expert system to use the knowledge for 
reasoning. Thus, the knowledge base contains a data structure that can be manipulated by 
an inference engine. The inference engine searches and performs pattern-matching 
operations on the data structure. Knowledge representation schemes include; 

• Propositional logic 

• Predicate calculus 

• Decision trees 

• Semantic networks 

• Production rules 

• Frames 
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5. Knowledge Engineering 

Knowledge engineering involves capturing expert knowledge and building a 
system that can use the knowledge. The process involves knowledge acquisition, 
validation, representation, and inferencing. 

6. Inference Engine 

The inference engine acts as the “brain” of the expert system. The inference 
engine knows how to use the system’s knowledge base, and the engine organizes and 
controls how the system solves a problem. 

C. KNOWLEDGE ENGINEERING 

The facts and mles contained in the knowledge base represent many different 
types of knowledge. Types of knowledge include meta-knowledge, theories, facts, 
objects, relationships, heuristics, and general knowledge. All types of knowledge must 
be gathered from various sources, such as, human experts, databases, documents, 
observations, and books. Knowledge must then be validated and properly represented in 
the system. The knowledge engineering process involves acquisition, validation, 
representation, and inference. A knowledge engineering specialist, the knowledge 
engineer, conducts the knowledge acquisition process. 

1. Acquisition 

The knowledge engineer elicits knowledge from experts and extracts knowledge 
from books, files, and documents. Knowledge acquisition usually requires the 
cooperation of human experts. Eliciting knowledge from human experts is a complex 
and difficult task, because human experts often make decisions based upon “gut feelings” 
(perception, insight, and intuition) that have been developed from years of experience. 
These “gut feelings” are difficult to explain, and motivating the human expert to explain 
the reasons for making a particular judgement call requires a skillful interviewer. The 
knowledge engineer must have the ability to elicit and codify this type of subjective 
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undocumented expertise. Knowledge acquisition often creates a bottleneck in the 
development of expert systems [Ref. 3]. 

Elicitation of knowledge from an expert can be conducted manually or with 
automated computer support. Manual methods typically involve face-to-face interviews, 
which can be slow and expensive. Therefore, expert system development tends to 
involve some level of automated support. 

Automated tools, such as, the Expertise Transfer System (ETS), provide the 
knowledge engineer with computer programs that interview experts and elicit knowledge 
via an interactive process. Automated systems can increase the productivity of the 
knowledge engineer by reducing the cost of knowledge acquisition. Automated systems 
use methods like data mining, rule induction, interactive induction, case-based reasoning, 
and neural computing to build a rule-based knowledge set. 

2. Validation and Verification 

Developers must validate and verify the knowledge base. Validation means that 
the knowledge base contains the right knowledge. Verification means that the knowledge 
base is constructed properly. The knowledge base can be verified by running test cases 
and testing the outcomes. Some knowledge acquisition programs possess automated 
verification capabilities. 

3. Representation and Inference 

Knowledge representation and reasoning/inferencing methodologies are discussed 
in the following two sections. 

D. KNOWLEDGE REPRESENTATION 

Knowledge representation involves storing and managing knowledge. Effective 
representation results in effective and competitive use of knowledge. Knowledge 
representation schemes can be programmed and stored in memory. Knowledge 
representation schemes are also constructed so that the knowledge contained in the data 
structure can be used in reasoning. The expert system reasons by manipulating the data 

structure to search the knowledge base and to apply pattern-matching techniques to make 
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inferences and conclusions about the knowledge base. Popular knowledge representation 
schemes include logic, semantic networks, production rules, and frames. 

1. Logic 

Knowledge may be represented by propositional logic and predicate logic. 
Generally, logical knowledge representation involves inputs (premises), logical 
processes, and conclusions (inferences). Logical processes produce conclusions based 
upon the inputs. Conclusions may then represent facts that are known to be true and may 
be used to make further inferences. Computers use symbolic logic to convert statements 
and the reasoning process into symbolic forms suitable for machine manipulation. 
Propositional logic (propositional calculus) and predicate logic (predicate calculus) are 
two fundamental forms of computational logic. 

Propositional logic manipulates propositions by using symbolic logic. 
Propositional logic determines whether a statement (proposition) is true or false. The 
truthfulness of the statement can then be used for deriving new inferences or 
propositions. Propositional logic uses symbols to represent propositions, premises, and 
conclusions. For example, consider the following syllogism: 

Premise P: All tigers are cats. 

Premise Q: Harry is a tiger. 

Conclusion R: Harry is a cat. 

The meaning of the words is not important in propositional logic. Consider the 
same syllogism as above, except that all nouns have been replaced by symbols: 

Premise P: All X are Y. 

Premise Q: Z is an X. 

Conclusion R: Z is a Y. 

Propositional logic makes inferences based on form rather than on meaning. 
Therefore, propositional logic treats both syllogisms above as essentially the same 
syllogism. The concept of separating form from meaning makes propositional logic very 
powerful, because the validity of an argument can be considered objectively without the 
prejudice of semantics [Ref. 4]. Logic may also be considered as a mathematical theory 
in this regard and can be used to prove mathematical theorems. 
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All propositions may be represented with symbols and then manipulated using the 
rules of propositional logic to make inferences. The syllogism above may be further 
expressed with symbols in the following way: P a Q R, which literally means, “If P is 
true and Q is true, then R is true.” Symbols include logical operators like “a” and 
which can connect two or more propositions to form propositions that are more complex. 
Table 16 depicts some common logical connectives. 



Table 16: Logical Connectives 



Connective 


Meaning 


A 


AND (conjunction) 


V 


OR (disjunction) 




NOT (negation) 


— > 


if... then (condition) 




if and only if (bi-conditional) 



Propositional logic is limited by the fact that propositional logic deals with 
complete statements only. Propositional logic cannot examine the internal structure of a 
statement; therefore, its ability to represent real-world knowledge is limited. In particular, 
propositional logic cannot prove the validity of propositions involving quantification like 
“all,” “no,” and “some.” 

Predicate logic, however, examines the internal structure of statements and can 
break a statement down into component parts. The component parts may be an object, a 
characteristic of the object, or some assertion about the object. The simplest form of 
predicate logic is called first order predicate logic, which is based upon first order 
theories. In first order theories, a set of objects is selected, and all the statements of the 
theory are statements about the objects. The set of objects is called the “domain,” and the 
objects in the domain are called “individuals.” Predicate logic uses quantifiers as 
described above to explicitly quantify other words to make statements more exact. 
Quantifiers permit a wider scope of expression than propositional logic permits. In fact, 
propositional logic is a subset of predicate logic. 

A universally quantified statement has the same truth-value for all individuals in 

the same domain. The symbol V represents the universal quantifier and is followed by 

one or more arguments for the domain variable. For example, in the domain of numbers 
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V(x) (x + X = 2x) means that for all x (where x is a number), the statement x + x = 2x is 
true. [Ref. 4] 

The statement “x + x = 2x” is a function and can be represented as a predicate 
function P(x). Therefore, the previous example can be written as (Vx) P(x). Predicate 
functions describe a property of the object. 

An existentially quantified statement means that the statement is true for at least 
one member of the domain. The symbol 3 represents the existential quantifier and is 
followed by one or more arguments for the domain variable. In the domain of numbers, 
the statement (3x) (x • x = 1) means that there is some x whose product with itself equals 
one. 

Artificial intelligence programming languages, particularly PROLOG, use 
predicate logic to represent knowledge. For example, let H be the predicate function for 
“human” and let M be the predicate function for “mortal.” Then the statement that all 
humans are mortal can be written as (Vx) (H(x) — > M(x)), which means that for all x, if x 
is human, then x is mortal. Furthermore, the statement can be represented as a semantic 
net, as shown in Figure 6. The statement may also be expressed as a rule: “If x is human, 
then X is mortal.” 




2. Semantic Networks 

Semantic networks graphically depict knowledge by showing the relationships 
between objects. In a semantic diagram, objects are called nodes and relationships are 
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called links. Figure 7 displays a semantic network, which is more complex than the 
network shown in Figure 6. 




Semantic networks provide a visual representation of relationships that can be 
combined with other knowledge representation methods. 

3. Production Rules 

Production rules represent knowledge via condition-action pairs, which typically 
look like IF-THEN statements: 

• Rule 1: If an organizational safety area receives an assessment that is less than 

zero, then the organizational safety area is weak. 

• Rule 2: If the survey contains three or more answers that are four standard 

deviations from the mean, then the survey may contain data entry errors. 

Each rule in an expert system represents a small chunk of expertise. Although 
each rule can be considered independent of any other rule, the set of rules actually 
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becomes highly interdependent within an expert system. Changing one rule will often 
affect one or more rules in the knowledge base. 

Rules may represent knowledge rules or inference rules. Knowledge rules are 
declarative and state all the facts and relationships about a problem. Rule 1 is an example 
of a knowledge rule. Inference rules are procedural and advise on how to solve a 
problem if certain facts are true. Rule 2 is an example of an inference rule. Inference 
rules can also define meta-rules, which are rules about rules. For example, a meta-rule 
could deactivate another rule if certain facts are true. 

Representing knowledge with production rules is especially applicable if the 
expert system will need to recommend a course of action based upon facts. Rules 
simulate the cognitive behavior of the human expert, because rules express knowledge 
via a natural form of knowledge (IF-THEN). Production rules are easy to understand, 
maintain, and combine with uncertainty. However, complex knowledge may require 
thousands of rules, which can make rule management difficult. 

4. Frames 

Frames provide an object-oriented data structure for representing knowledge. A 
frame is a concise hierarchical structure that contains the characteristics and attributes for 
an object. An object may be a thing, a situation, or a problem. Expert systems rely upon 
frames extensively for describing domains and domain instances. 

An example of a frame is as follows; person (name, hair_color, eye_color). The 
frame describes an object of the domain “person,” and knowledge about the object is 
contained in “slots.” The slots are name, hair_color, and eye_color. The frame could be 
used as follows: person (John, blonde, blue). Intuitively, the frame then describes an 
instance of person named John who has blonde hair and blue eyes. 

E. REASONING METHODS 

Expert systems solve problems by reasoning, which is also called inferencing. 

Ideally, humans reason and computers make inferences. Expert systems make inferences 

by applying logical processes on the knowledge base. Expert systems use rules, 

inference trees, frames, models, and cases to make inferences. Furthermore, inferences 
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may be made with certainty or uncertainty. First, this section discusses the five popular 
inferencing methods. Second, this section introduces the concept of reasoning under 
uncertainty. 

1. Rule-based Inferencing 

Rule-base inferencing uses either forward chaining or backward chaining to create 
a chain of inferences that connect a problem to a solution. In forward chaining, the chain 
proceeds from the problem to the solution. Therefore, forward chaining reasons from the 
facts to the conclusion. In backward chaining, the chain proceeds from the solution to the 
problem. The backward chain starts at the hypothesis and traverses back through the 
facts that support the hypothesis. If the chain is unable to find facts that support the 
hypothesis, then the hypothesis must be false. 

Artificial intelligence programming languages, particularly PROLOG, use 
backward chaining for inferencing. Backward chaining is a goal-driven approach. 
Reasoning starts from a hypothesis, or a goal, and then seeks to verify the hypothesis as 
true or false. The inference engine attempts to find a rule that has the goal in its 
conclusion. For example, consider the following expert system that has the following 
information in its knowledge base: 

• Fact: Dog (Rover) 

• Rule 1: Dog (x) — > Mammal (x) 

• Rule 2: Mammal (x) Animal (x) 

Assume that the goal, or hypothesis, is Animal (Rover). In other words, the expert 
system will decide if Rover is an animal. Backward chaining starts with the hypothesis. 
Animal (Rover), and works backwards through an inference chain until it finds a fact that 
supports the hypothesis. In this case, the inference engine will follow the inference chain 
(Rule 1 and Rule 2) backwards to the fact. Dog (Rover). The inference engine will 
determine that the hypothesis. Animal (Rover), is true. 

Expert system shells, particularly CLIPS, use forward chaining for inferencing. 
Forward chaining is a data-driven approach. Reasoning starts with all the known facts, or 
data, and then seeks to match the facts to the IF conditional elements of the IF-THEN 
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rules in the knowledge base. The inference engine makes conclusions as it tests each 
rule. If the facts match the conditional elements of the IF portion of the rule, then the 
conclusion must be true. For example, consider the same knowledge base as explained in 
the previous paragraph. The inference engine will examine each rule and look for 
matching facts. If matching facts are found, the engine will activate the rule and add new 
facts to the knowledge base if required. The new facts may subsequently cause other 
rules to be activated. In this case, the engine starts with Rule 1 and finds that Dog 
(Rover) matches the conditional element. The engine adds a new fact. Mammal (Rover), 
to the knowledge base. The engine then examines Rule 2 and finds that Mammal (Rover) 
matches the conditional element. The engine adds a new fact. Animal (Rover), to the 
knowledge base. Thus, the engine has successfully determined from the facts that Rover 
is an animal. 

Forward chaining and backward chaining have characteristics that make them 
better suited for certain tasks. Forward chaining is well suited for problems involving 
planning, monitoring, making conclusions about the facts, and predictive analysis. 
Backward chaining is well suited for problems involving diagnosis, finding evidence to 
support the conclusion, and explanation. Although each chaining method has its own 
characteristics, that does not mean that one method cannot solve problems that the other 
method is better suited to solve. A forward chaining method can be used for diagnosis 
and a backward chaining method can be used for planning. Some expert system shells, 
like Jess, enable both forward and backward chaining. 



2. Inference Trees 

Inference trees depict the inference process schematically. In fact, some 
applications, like G2, can display the knowledge base visually with an inference tree. As 
shown in Figure 8, premises and conclusions are shown as nodes. Branches connect the 
premises to the conclusions. The connection between a premise and a conclusion 
represents a rule. Conclusions can be connected via AND and OR nodes. Inference trees 
do not provide deeper reasoning capabilities than other reasoning methods provide. 
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Inference trees simply provide a visual representation of the knowledge base, so that the 
structure of rules may be inspected and interpreted in a convenient manner. 




Figure 8: Backward Chaining Inference Tree 



3. Frame-based Inferencing 

Expert system shells commonly use frames and rules to make inferences about 
objects. A rule can reason about the characteristics of a frame by referring to the frame’s 
slot value. For example, consider the following frame and rule; 

• Frame: truck (weight) 

• Rule: If the weight of the truck exceeds 2,000 pounds, then suggest a detour. 
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Then for the domain instance, truck (3,000 pounds), the expert system would suggest a 
detour. 



4. Model-based Inferencing 

Model-based reasoning depends on knowledge of the structure and behavior of a 
model, rather than depending on production rules that represent expertise. The 
knowledge engineer must create a complete and accurate model of the system in order to 
effectively implement model-based reasoning. Devices, such as machines and 
computers, possess behaviors that are relatively easy to model. Therefore, model-based 
reasoning is especially suitable for diagnosing difficult equipment failures. Model-based 
reasoning is often combined with other knowledge representation and inferencing 
methods like frames and rules. 

Two types of general model types include mathematical models and component 
models. Mathematical models can describe behaviors via mathematics. A mathematical 
model may be used to describe the flow of water through a pipe. The model would 
account for the size of the pipe and the rate of flow to predict and diagnose the behavior 
of the system. A component model, however, would treat the pipe and the water as sub- 
components of a model. Each component would adjust its characteristics according to its 
behavioral model, and then each component would adjust itself via interaction with other 
relevant components. 

5. Case-based Inferencing 

Case-based reasoning creates new solutions based upon other solutions that were 
used to solve previous problems. This method requires that the system find relevant 
cases. Finding relevant cases involves [Ref. 3]: 

• Characterizing the input problem by assigning appropriate features to it. 

• Retrieving cases from memory that have the same features. 

• Picking the case(s) that match the input best 

Cases are the primary elements in case-based reasoning systems. A case may be 
as simple as a script that describes a well-known sequence of events. The case-based 
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inference engine finds a case that most likely matches the new problem by reviewing 
stored scripts. Then the script is applied to the new problem. Case -based reasoning is 
often combined with other knowledge representation and inferencing methods. If a 
domain cannot be formalized with rules, then case-based reasoning may offer a solution. 
The domain may not facilitate the formation of rules, because the domain has a weak 
causal model or contradictory rules may apply in different situations. Sometimes the 
output may be too complex to be expressed as rules, such as, battle plans or political 
analysis. 



6. Reasoning With Uncertainty 

Humans are very good at making decisions under uncertainty. Computers, 
however, are challenged when making certain decisions under uncertain conditions. The 
knowledge representation schemes and inferencing methods introduced so far have dealt 
with exact reasoning only. Exact conclusions have been deduced from exact facts. Real 
situations, however, often require conclusions to be made under uncertain situations. The 
goal of an expert system is to find the “best” solution, and if a system fails to deal with 
uncertainty, then the best solution may be overlooked. Unfortunately, determining the 
best conclusion is not always easy. Several methods have been developed for dealing 
with uncertainty, and the expert system designer must choose the appropriate method. 
Methods include various probability theories, certainty theories, and fuzzy logic. 

All methods that deal with uncertainty attempt resolve errors that contribute to 
uncertainty. Different types of errors include ambiguity, incompleteness, incorrectness, 
randomness, measurement errors, systematic errors, and reasoning errors. 

Probability theory provides a quantitative means for dealing with uncertainty. 
Pascal and Fermat first proposed classical probability in 1654. Classical probability is 
called a priori probability, because the theory deals with ideal systems without regard to 
the real world. An a priori probability assumes that all possible events are known and 
that each event is equally likely to happen. Formal probability theory is defined by three 
axioms: 

• Axiom 1: 0 < P(E) < 1 

• Axiom 2: Si P(Ei) = 1, where all Ei are mutually exclusive 
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Axiom 3: P(Ei + E 2 ) = P(Ei) + PCEa), where Ej and E 2 are mutually exclusive 






In each axiom, P(E) represents the probability of event E occurring. Axiom 1 
defines the range of probability to be the real numbers from zero to one. If an event is 
certain, then the event’s probability is one. Conversely, if an event is impossible, then 
the event’s probability is zero. Axiom 2 declares that the sum of all mutually exclusive 
events is one. A corollary to Axiom 2 states that P(E) + P(E’) = 1, where E’ is the 
complement of E. Therefore, the occurrence and non-occurrence of an event are 
impossible. Axiom 3 states that if two events are mutually exclusive, then the probability 
of one or the other occurring is equal to the sum of their individual probabilities. The 
formal axiomatic definition of probability theory supports the deduction of probability 
theories outside of a priori probability. For example, experimental probability (a 
posteriori probability) describes P(E) as the limit of a frequency distribution: P(E) = 
limN^ ( f(E) / N ), where f(E) is the frequency of outcomes of an event for N observed 
total outcomes. Experimental probability induces an event’s probability from an event's 
frequency in a large number of trials. 

Subjective probability is not supported, however, by axioms or empirical 
measurements. Instead, subjective probability assigns probabilities based on beliefs, 
experience, judgement, and opinions. In fact, uncertainty is represented as a degree of 
belief called a certainty factor, rather than as a probability. Types of subjective 
probability theory include certainty theories and fuzzy logic. Subjective probability 
allows expert systems to reason about non-repeatable events like medical diagnoses and 
mineral exploration. Realistically, any medical diagnosis is a conditional probability that 
can be interpreted as a degree of belief that the conclusion is true. All patients are 
unique, so the problem is non-repeatable. Therefore, a medical diagnosis does not 
represent a probability, but rather a degree of belief that the diagnosis is correct. 

F. THE JAVA EXPERT SYSTEM SHELL (JESS) 

The Java Expert System Shell (Jess) is an expert system shell written completely 
in the Java programming language. Jess supports the development of rule-based expert 
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systems. The expert system can be written entirely with scripts or Java, or partially with 
scripts and partially in Java. Jess was written by Ernest J. Friedman-Hill at Sandia 
National Laboratories, and it can be downloaded at no cost on the World Wide Web at 
http://herzberg.ca.sandia.gov/jess. 

Jess was originally a porting of the CLIPS expert system shell, which is written in 
C, to the Java language. Jess has diverged from CLIPS during its continuous 
development, but Jess retains many similarities to CLIPS. A person familiar with CLIPS 
and Java should have little difficulty in learning how to use Jess. 

Jess uses a very efficient algorithm for matching facts with the conditional 
elements of rules to determine which rules have had their conditions satisfied. The 
algorithm is called the Rete Matching Algorithm. The Rete Algorithm is necessary for 
efficiency, because the inference engine must constantly examine the facts for matches. 
If the engine needed to examine the fact list only once, then no algorithm would be 
necessary. However, the matching process occurs repeatedly in rule-based expert 
systems. Therefore, an efficient method for pattern matching must be used. The 
alternative is for the inference engine to inspect every rule and every fact during each 
execution cycle. 

The Rete Algorithm takes advantage of the temporal redundancy exhibited by 
rule-based expert systems. Temporal redundancy refers to the idea that facts change 
slowly over time. Only a small number of facts are added or removed between each 
execution cycle. Therefore, the engine does not need to examine every fact during each 
cycle. The Rete Algorithm achieves its efficiency by remembering previous matches 
between cycles and by knowing which facts have changed. During an execution cycle, 
the engine determines only how the new facts have affected the state of the matching 
process. 

Jess contains the Java classes necessary for creating a knowledge base and an 
inference engine. Creating an expert system in Jess involves writing rules in Jess syntax, 
loading facts into the knowledge base, and then running the inference engine. Both rules 
and facts may be loaded into Jess via scripts that are written in the Jess syntax. The Jess 
distribution includes a parser class that will parse a script and load it into the knowledge 



47 



base. Facts may also be loaded from Java via the Rete.assert() method, the Funcall.addQ 
method, or the Rete.executeCommandQ method. 

JavaBeans may also be added to the knowledge base as facts. The advantage to 
this Jess feature is that the slot values of the fact will always match the attributes of the 
bean. Jess uses the java.beans.PropertyChangeSupport class and reflection to update 
facts in the knowledge base that represent beans in a Java application. The ACSA Safety 
Agent application takes advantage of this feature by using JavaBeans for Question 
objects and for Safety Area objects. 

G. THE ACSA SAFETY AGENT AND JESS 

1. Installing Jess 

Download Jess from http://herzberg.ca.sandia.gov/jess. The distribution should 
include specific installation instructions, but the procedures for installing Jess 5.0 is 
briefly covered here. Unzip the archive. Place the Jess package in the machine’s 
classpath environment variable. Compile the Jess package. If the package compiles 
successfully, then Jess is installed and is ready for use. 

2. Writing Jess scripts 

The ACSA Safety Agent loads fact templates and rules into the the knowledge 
from a script file. The script, rules.clp, is included in Appendix C. Jess scripts contain 
code written in Jess syntax and can be parsed by the Jess Parser class. Jess syntax is very 
similar to CLIPS syntax and is well documented in the distribution. 

The rules.clp file is located in the safetyAgent.agentApp.resources package. The 
location allows the application to use the Class. getResource() method to load the file, so 
that the file may be loaded regardless of the directory from which the application is run. 
To change a rule in the ASCA Safety Agent application: open the script in a text editor, 
modify the contents, and save the script in the safetyAgent/agentApp/resources directory. 
If the file is moved from this directory, the agent will be unable to find the rule file. 
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3. Using Jess with Java 

Jess may be used with Java in many different ways. The difficult decision is 
deciding which method is appropriate. Rules are best implemented via scripts, since the 
rules tend to be static. Facts, however, can be implemented by loading scripts, calling 
methods, or via JavaBeans. The ACSA Safety Agent calls methods and uses JavaBeans 
for managing facts in the knowledge base. A fact may be loaded via a script if the fact is 
known to be true every time the script is loaded. leading facts via method calls are 
useful for facts that need to be added at certain points during execution. Using JavaBeans 
for facts are useful when the attributes of the fact will change frequently. 

The ACSA Safety Agent uses beans for the Question and Safety Area facts, 
because the statistical data about the objects may change frequently and questions and 
safety areas are tied to the user’s preferences. A user may de-select a question or a safety 
area from the assessment process at any time. Facts that are implemented as JavaBeans 
are updated dynamically as the attributes of the beans change. This feature makes coding 
much easier, because the code does not need to make method calls to retract, modify, and 
re-assert a fact every time a slot’s value changes. 
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V. SOFTWARE AGENTS 



A. INTRODUCTION 

Software agents act as computerized servants. Humans create and employ agents, 
but humans typically neither directly supervise nor direct an agent’s activities. Humans 
define an agent’s capabilities and behaviors, and the agent acts in a relatively autonomous 
manner in accordance with their programmed capabilities and behaviors. Agents can 
sometimes learn and adapt their behavior accordingly. Agents can usually communicate, 
cooperate, negotiate, and even collaborate with other agents. They can assist people and 
can ideally interact with people in human-like ways. Some software agents attempt to 
simplify the use of computers by improving human-computer interaction. For example, 
word processors and spreadsheet programs, like Microsoft Word and Excel, use agents as 
“wizards” to assist users and to automate complex tasks. Microsoft Office uses agent 
technology in its animated assistants like the paperclip that taps on the monitor when it 
has an idea. This chapter discusses how software agents are defined, the characteristics 
of agents, the reasons for choosing an agent, the difficulties of producing intelligent 
software agents, and current agent technologies. This chapter will also discuss aspects of 
the ACSA intelligent agent where appropriate; however, a more detailed discussion is 
provided in Chapter VI, "Development of the ACSA Intelligent Agent." 

B. WHAT ARE SOFTWARE AGENTS? 

Software agents are programs, which carry out tasks by proxy on behalf of a user 
or a group of users. Agents are often called software robots, softbots, or bots. Agent 
capabilities vary widely from basic skills, such as, automating straightforward routine 
tasks, to advanced skills, such as, adapting to user routines and preferences and 
negotiating on someone's behalf. The characteristic that distinguishes agents from other 
software programs is that agents can automatically adapt their behavior to the conditions 
they encounter and make simple to complex decisions without specific on-the-spot 
instruction from the user. An agent's degree of autonomy depends upon the agent's level 
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of sophistication. An agent’s capacity for autonomous behavior may include taking the 
initiative, such as, providing the user with information that is not specifically requested 
by the user but may be of interest to the user. Software agents can be described in terms 
of agency, intelligence, and mobility. [Ref. 5] 

1. Agency 

Agency is the degree of autonomy and authority that is entrusted to an agent. 
Autonomy can be measured qualitatively by the nature of the interaction between the 
agent and the other entities in the system. The degree of agency is enhanced if an agent 
represents a user and acts as an agent for a user. Agency is an essential characteristic of 
an agent. An advanced agent can interact with other entities such as data, applications, or 
services. More advanced agents can collaborate and negotiate with other agents. [Ref. 5] 

2. Intelligence 

What exactly makes an agent “intelligent” is difficult to define, and the definition 
of intelligence has been the subject of many discussions in the field of artificial 
intelligence. A definitive answer has yet to be found. This chapter, however, will use the 
following definition as a working definition: 

Intelligence is the degree of reasoning and learned behavior: the 
agent's ability to accept the user's statement of goals and carry out the task 
delegated to it. 

At a minimum, there can be some statement of preferences, 
perhaps in the form of rules (an Expert or Knowledge Based System), with 
an inference engine or some other reasoning mechanism to act on these 
preferences. 

Higher levels of intelligence include a user model or some other 
form of understanding and reasoning about what a user wants done, and 
planning the means to achieve this goal. 

Further out on the intelligence scale are systems that learn and 
adapt to their environment, both in terms of the user's objectives, and in 
terms of the resources available to the agent. Such a system might, like a 
human assistant, discover new relationships, connections, or concepts 
independently from the human user, and exploit these in anticipating and 
satisfying user needs. [Ref. 6] 
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3. Mobility 



Mobility is the degree, to which, agents can travel through a network. Agents may 
be static or mobile. A static agent may reside on a client machine (to manage a user 
interface, for instance) or reside on the server. Mobile agents may be created on one 
machine and then shipped to another for execution in a suitably secure environment. In 
this case, the program travels before execution, so no state data is included with the 
program. However, agents may also be mobile with state and transported from machine 
to machine in the middle of execution carrying accumulated state data with them. Such 
agents may be viewed as mobile objects, which travel to agencies where they must 
present their credentials to obtain access to services and data managed by the agencies. 
Agencies may also serve as brokers or matchmakers, bringing together agents with 
similar interests and compatible goals, and providing a “meeting point” where agents can 
interact safely. [Ref. 5] 



C. WHY USE AN INTELLIGENT AGENT? 

Computers are increasingly connected to each other and to larger networks, 
including the Internet. Data and information flow at the speed of light between millions 
of computer systems day and night seven days a week. The potential for information 
overload is tremendous. Too much data arriving at inhuman speeds and arnounts can 
make it difficult to find information that is useful. Therefore, there is a growing need for 
tools to help manage information collection, management, and analysis. Intelligent 
agents, which are sophisticated software tools that incorporate aspects of artificial 
intelligence, act independently on the user's behalf, and may offer solutions to some 
major computer and database management needs. 

Information access and management is an area of great activity, given the rise in 
popularity of the Internet and the explosion of data warehouses available to users. In the 
past few months alone, the on-line ASCA database has grown more than 40 percent in 
size from 250 respondents to over 350 respondents. More importantly, though, NFS has 
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continued to issue survey numbers to squadrons, and the size of the database is projected 
to grow at a higher rate than before. As the database grows in size, the amount of data 
that researchers can analyze will become a smaller percentage of all data in the database. 
Therefore, researchers need a tool that can analyze the database for them automatically 
and discover anomalies and make conclusions based on rules that express the researchers’ 
expert domain knowledge. For example, the ACSA Safety Agent can inspect the ACSA 
database for data integrity and can make decisions about organizational safety assessment 
information contained in the database. The ACSA Safety Agent can generate and deliver 
safety assessment and database integrity reports automatically to a variety of destinations, 
including email, printer, file, or computer display. 



D. DIFFICULTIES IN BUILDING AN INTELLIGENT AGENT 

Agents and agent technology have been an active area of research in the artificial 
intelligence and computer science community for a number of years. Many universities 
have developed intelligent software agents. A number of companies deliver software 
agents capable of performing a wide variety of specialized tasks. However, each of these 
agents were handcrafted for a particular application. Building an intelligent software 
agent is a difficult and time-consuming task that requires an understanding of advanced 
technologies, such as knowledge representation, reasoning, network communications 
methods and protocols, and distributed programming. Sophisticated applications often 
require expertise in machine learning and machine planning technology. 

A developer using intelligent agents in a new application must decide on the 
overall agent processing architecture, the agent’s reasoning mechanism and associated 
pattern matching technology, internal knowledge and data representations, agent-to-agent 
communications protocols, and message formats. In addition, if the agent is to learn from 
its environment or its owner, then some kind of machine learning technology will be 
required. Sophisticated agents may require a planning capability, and this will require that 
the developer select a planning algorithm and implementation. If the application requires 
multiple communicating agents, then the developer must establish a robust 
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communications protocol between the agents. Therefore, the developer will need to know 
about the underlying communications technologies used for inter-agent communications. 



E. AGENTS IN USE TODAY 

Intelligent agents are currently being used or developed for a variety of uses, such 
as, personal assistants, information gathering, data mining, and telecommunications. 
Since these software agents perform specific tasks as directed by the user, these programs 
are often called bots, a nickname that quickly identifies them as on-line intelligent agents 
that behave like software robots. BotSpot, a website resource for bot information, lists 
over 1,000 bots on its website at http://bots.intemet.com. The site lists the bots by 
category, of which, there are eighteen. Categories include commerce bots, email bots, 
data mining bots, chat bots, game bots, government bots, fun bots, news bots, newsgroup 
bots, search bots, shopping bots, stock bots, software bots, knowledge bots, and update 
bots. This section, however, limits its discussion of example intelligent agent software 
programs to the following more general categories of personal applications, business 
applications, telecommunications, expert systems, computer diagnostics, network 
management and monitoring, and email filtering and sorting. 

1. Personal Applications 

Personal applications include agents that perform services for an individual 
person, such as, gathering news stories or helping a user write a letter in Microsoft Word. 
Two examples of personal application agents include Paperboy and Microsoft Office 
Assistants. 

Paperboy, which is offered by Heurics Systemhaus, compiles a personal 
newspaper from daily newspapers based on user-specified topics and delivers a personal 
daily newspaper via email to the user. The agent uses a mle-based search engine that 
searches U.S. and European publications for newspaper stories that may satisfy the user’s 
preferences. Online searching via keyword or complex queries is also possible and very 
fast. Paperboy is available on the World Wide Web in English and in German at 
www.paperboy.de. 
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Microsoft includes agent technology in all of its Microsoft Office products. The 
most obvious agent in Microsoft Office is the Office Assistant, which appears as an 
animated paperclip by default. The agent can also be configured to appear as an 
exclamation point, Albert Einstein, a smiley face, a red rubber ball, or some other 
assistant that is offered in Microsoft Office. More assistants can also be download from 
the web. Microsoft has attempted to make the assistants’ look-and-feel as personally 
configurable as possible. Office Assistants can help users with many tasks in Microsoft 
Office, such as, formatting a letter or creating a table. The agent will also appear if the 
agent determines that the user might be doing something where the agent might be able to 
help. For example, if a user starts to write a letter, the agent may automatically appear as 
soon as the user enters "Dear Mom,". The agent will tell the user that it appears that the 
user is writing a letter and will ask the user if he or she would like help with the format of 
the letter. 

Financial planning services use agent-driven expert systems to reduce the costs of 
their services. Agents have made the planning process quicker, easier, and more 
consistent. Financial plans can help individuals with insurance, retirement, investments, 
income taxes, estate planning, and cash and debt management. The plans have general 
rules and should be flexible enough to accommodate personalized options, risk attitudes 
and individual preferences. 

2. Business Applications 

An intelligent agent in use at Hewlett-Packard Co. is currently helping automate a 
quarterly wage-review process that covers approximately 13,000 salespeople. The 
software, which runs on a personal computer, performs essentially the same tasks as a 
team of 20 administrators. [Ref 7] 

The implementation of a knowledge-based system at John Hancock Mutual Life 
Insurance Company provides an example of the potential for incorporating agents into 
core business processes. John Hancock processes a very large volume of new insurance 
applications, in excess of several hundred thousand applications each year. New life 
insurance applications come from over 300 field offices maintained by John Hancock 

across the country. Underwriting had always been performed at corporate headquarters. 
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In 1986, an internal technology consultant in the corporate data processing department 
considered a variety of new technologies as they might be applied to insurance. The 
consultant then developed a plan for applying expert systems. With the participation of 
five experienced underwriters and twelve computer programmers, the consultant 
completed the system in four years. Currently, the expert system does a large portion of 
the work that had to be done manually before. The applications from over 300 field 
offices are now processed through the expert system. [Ref. 7] 

The very nature of the John Hancock’s business dictated a "front-end" focus for 
initial expert systems development efforts, because the requirement was to automatically 
approve as many new cases as possible without human intervention. The nature of John 
Hancock’s retail life insurance business, i.e., the large volumes of new applications, was 
highly amenable to a production-oriented underwriting system. [Ref. 7] 

The banking industry has used expert systems in many cases with good results in 
areas concerning trade decisions, credit decisions, loan applications, and opening new 
accounts. As technology makes banking convenient, customers can access banking 
services and do banking transactions any time and from anywhere. 

Many financial companies use expert systems for credit analysis. The benefits of 
using expert systems for credit analysis are speed and accuracy, both of which far exceed 
human capacity. American Express uses expert systems to process unusual requests. The 
system, called Authorizer’s Assistant, can process requests much quicker than a customer 
service representative can, and the agent has decreased errors by nine percent. 

3. Telecommunications 

Telescript is part of an environment designed to serve as a platform for 
communications applications (including intelligent agents) and a foundation for personal 
communicators. Matsushita, Motorola, Philips, and Sony (members of the General Magic 
alliance) are licensees of the new technology and are building hand-held Magic Cap 
communicators. 

The Magic Cap environment includes most modes of communication currently 
available, including; 

• fax 
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• public electronic mail services 

• telephones 

Telescript technology allows users to launch their intelligent agents to perform 
tasks such as screening, routing, and delivering electronic correspondence. They will also 
be able to shop for goods and services and seek out time-critical information. 

AT&T’s PersonaLink Services, which uses the Telescript technology, will support 
smart messaging and host a variety of service providers, from personal newspapers to 
travel services to electronic shopping. 

Integrated with its core communication capabilities. Magic Cap software includes 
features to help manage personal information; address cards that automatically get 
updated as the sender’s information changes, a calendar that issues invitations to 
meetings, and a notebook that supports free-form and stmctured notes. 

Magic Cap software will be available in handheld communicators and as software 
mnning on personal computers, so customers can use it whether they are mobile or at 
their desks. In addition, for those who use the software on a personal computer and also 
own a Magic Cap communicator, appointments, addresses, and other data will be 
reconciled when the two are connected. 

Since both the Magic Cap hardware standard and Magic Cap software are 
extensible, manufacturers will be able to create a variety of Magic Cap-based products 
that incorporate their unique expertise and differentiate their products from others in the 
market. Two-way communication is built into every Magic Cap communicator. 
Customers will have a range of Magic Cap products to choose from-wireless and 
wireline, mobile and stationary — all of which will take advantage of the growing library 
of products and services developed by independent vendors and all of which will 
communicate. 

4. Expert systems (specialized knowledge-based applications) 

One of the results of research in the area of artificial intelligence has been the 
development of techniques that allow for the modeling of information at higher levels of 
abstraction. These techniques are embodied in languages or tools that allow programs to 
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be built that closely resemble human logic in their implementation and are therefore 
easier to develop and maintain. These programs, which emulate human expertise in well- 
defined problem domains, are called expert systems. The availability of expert system 
tools, such as CLIPS and Jess, has greatly reduced the effort and cost involved in 
developing an expert system. 

Rule -based programming is one of the most commonly used techniques for 
developing expert systems. In this programming paradigm, rules are used to represent 
heuristics, or "rules of thumb," which specify a set of actions to be performed for a given 
situation. Some of the uses of expert systems today include, but are not limited to: 

• Medical use (diagnosis processing, treatment regimens, patient 
record/payment info-tracking, and insurance coverage processing) 

• Law (case classification and analysis, precedent tracking) 

• Law enforcement (suspect identification, case comparison, and info-tracking) 

• Translation services (conversion of text written in one language into another 
language) 

• Customer trouble-shooting services (help desk services, repair requests) 

5. Computer Diagnostics 

Intelligent agents are often used to do check-ups on a computer’s operating 
system. Sometimes intelligent agent software can configure the computer (installing 
programs, setting preferences, etc.) as well. 

If a computer is a stand-alone unit, the intelligent agent software can be loaded 
onto the computer via a floppy disc or CD-ROM. If the computer is part of a network, 
then someone authorized to do computer or network management can use intelligent 
agent software to access the operating system of each of the computers on the network to 
do the following kinds of tasks: 

• Diagnose problems on a specific computer 

• Re-configure or make adjustments to the operating system 

• Install and uninstall programs, documents, or miscellaneous stored data. In 
business, this process ensures that individual desktop computers have 
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sufficient storage space by routinely archiving documents of a particular type 
that were created either by a someone who has since left the company or 
before a certain date. 

These types of applications are becoming more and more important as ways that 
computer equipment can be made ready for use by the first user, the next user, and so on. 
These applications also make it easier for re-sellers or re-users to identify and address 
problems on individual computers. 

6. Network Systems Management and Monitoring 

Network administrators use intelligent agent software to observe operations in 
progress, monitor use of particular resources or programs, and provide fairly complex use 
reports. These functions allow the network administrators to decide, for example, when 
the network is likely to need more storage capacity or when it may be necessary to do 
archiving of old data to free up space on the hard drives of various individual computers. 

These types of tasks are now often handled from the network server level rather 
than having service personnel go around and access each computer individually. This can 
niake an enormous difference in the time it takes, for example, to upgrade versions of 
software used by each of the computers in a company. 

In addition, this type of network use of intelligent agent software allows 
commercial software vendors to upgrade or trouble-shoot the software directly, over the 
Internet and then via the company’s network server. 

Computer networks are increasingly critical to an efficient and effective work 
environment. Unfortunately, there are many things that can adversely affect an optimally 
functioning network system, such as 

• power surges or power interruptions 

• computer viruses 

• unauthorized use of the system (system break-in from outside or damage 
caused by internal users) 

Networked systems allow users access to many useful resources. Unfortunately, 
the connected nature of networked systems means that the system may be adversely 
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affected through its connections. Whether the damage is intentional or unintentional, 
intelligent agent software can help find out what went wrong and help get the system up 
and running again much more quickly than was previously possible. 

7. E-mail Filtering and Sorting 

E-mail has quickly become one of the single most important business tools in use 
today. It allows a much greater and more efficient system of communication for many 
business users. However, e-mail is subject to the same types of problems that the 
previous paper mail system has had problems with: 

• junk e-mail, “spam,” or otherwise unsolicited e-mail 

• unwanted e-mail that was sent by people you know, but that you don't want to 
reply to immediately 

• mass mailing e-mail and misdirected e-mail 

Intelligent agent software offers some fairly sophisticated techniques for handling 
e-mail, such as: 

• sorting 

• filtering 

• routing 

• prioritizing 

In addition to these duties, more complex e-mail intelligent agents can leam your 
preferences. For example, the intelligent agent may recognize an address that the user 
always ignores messages from. The intelligent agent may — even if the user never 
instructed the agent to do this specifically - leam that you don't consider messages from 
that source important and, over time, may assign these messages lower and lower 
priority. 
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F. 



AGENT TECHNOLOGIES 



There is a tremendous amount of advancing technologies that will rely heavily 
and contribute to future agent development. Most of these technologies can fit into one of 
three categories discussed below: 

1. Programming Languages 

The use of object-oriented programming technologies, including object-oriented 
operating systems, databases and programming techniques, will make it easier to develop 
intelligent agents that are able to search across a variety of computer hardware and 
software platforms. Java seems to be the language of choice for building agents, because 
Java is object-oriented and has robust built-in libraries for networked programming. 
Software developers can create powerful intelligent agents in Java that execute on a wide 
variety of computer platforms and operating systems. 

2. Intelligent Reasoning 

Intelligent reasoning is the true backbone of agent technology and development. 
The quest to develop even smarter intelligent agents is an ongoing process that will 
include many cutting edge technologies. Some of the main technologies supporting 
intelligent agents are: 

• Neural network technology is excellent at identifying relationships and 
automatically learning to recognize patterns based on digestion of large 
amounts of data. The ability to learn is an important characteristic for 
intelligent agents. Neural network technology expects to be closely linked to 
the development of intelligent agents in the future. 

• Fuzzy logic enables software and hardware to handle imprecise data will 
make it very important in handling tasks where it is difficult to precisely 
define information that is sought or tasks that must be completed. 

• Genetic algorithms help in automating the learning process for intelligent 
agents. This technology causes computer programs to mutate, with the result 
that they evolve into a series of new programs. The value of these mutant 
programs is then evaluated externally. The most valuable mutant programs are 
selected to mutate again. Using this Darwinian process of selection, optimum 
programs for a given environment are generated relatively quickly. Integrating 
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genetic algorithms with fuzzy logic will allow fuzzy logic programs to 
optimize themselves or to adapt to changing conditions. 

• Expert Systems capture knowledge from a human expert and encode the logic 
into a computer system. This approach requires intensive human intervention 
in capturing and encoding knowledge. Expert systems consisting of a 
relatively small number of rules may be embedded into intelligent agents, but 
this technology is not likely to be used extensively as expert systems perform 
very poorly when data is imprecise. 

3. Communications 

In order for an intelligent agent to be useful, it needs to have the ability to 
communicate efficiently and with ease. While there are many technologies expanding the 
way the world looks at everything, a couple of communications technologies are very 
promising: 

• Computer systems that can understand written, typed or spoken language will 
be important for intelligent agents to be successful. The use of natural 
language to tell an agent what to do will make the agent considerably more 
useful to computer users. 

• Increased computing speed and densities will make it possible for larger, more 
sophisticated intelligent agents to run in the background without hindering 
other tasks that a computer needs to do. This includes higher speed modems, 
DSL, and cable 

G. AGENT SOFTWARE PACKAGES AND VENDORS 

There are many commercial vendors and research projects that support software 
intelligent agent development. Software agents and agent systems are modeled object- 
oriented using the latest findings of software architecture. This approach describes the 
software architecture as a system of components whose interactions are realized via 
connectors. With the architecture-based methodology, theoretical fundamentals for the 
implementation of computer-independent platforms for agent programming have been 
found. While this is in no way an exclusive list of all agent software and vendor’s 
packages, the following is a listing of some of these packages and a brief description of 
how they work [Ref. 8]: 
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1. AgentBuilder by Reticular Systems, Inc. 

AgentBuilder is an integrated tool suite for constructing intelligent software 
agents. AgentBuilder consists of two major components - the Toolkit and the run-time 
System. The AgentBuilder Toolkit includes tools for managing the agent-based software 
development process, analyzing the domain of agent operations, designing and 
developing networks of communicating agents, defining behaviors of individual agents, 
and debugging and testing agent software. The run-time System includes an agent engine 
that provides an environment for execution of agent software.Agents constructed using 
AgentBuilder communicate using the Knowledge Query and Manipulation Language 
(KQML) and support the performatives defined for KQML. In addition, AgentBuilder 
allows the developer to define new interagent communications commands that suit his 
particular needs. 

All components of both the AgentBuilder Toolkit and the Run-Time System are 
implemented in Java. This means that agent development can be accomplished on any 
machine or operating system that supports Java and has a Java development environment. 
Likewise, the agents created with the AgentBuilder Toolkit are Java programs so they can 
be executed on any Java virtual machine. The AgentBuilder toolkit is designed to provide 
the agent software developer with an integrated environment for quickly and easily 
constructing intelligent agents and agent-based software. 

2. Agentx by International Knowledge Systems 

Agentx is a second generation, state of the art, set of lightweight, high 
performance, and scaleable distributed computing libraries for the Java programming 
environment. The libraries were designed to provide object request broker facilities that 
were easier to use, faster, more compact and highly functional, than the RMI libraries 
bundled with the Sun JDK or generally available Java based CORBA implementations. 
Unlike the aforementioned tools Agentx does not require the use of an interface 
definition language nor force the creation of stub or skeleton code. In addition Agentx is 
fully compatible with the Sun, IBM, and Microsoft virtual machines as well as the latest 
versions of both Internet Explorer and Netscape Navigator. 
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In addition to ORB functionality, Agentx also provides programming support for 
the creation and release of autonomous mobile agents. Objects can move around on the 
network, attach themselves to a host, and begin independent execution of their program 
code. This new technology allows for a complex computer program, or computationally 
intensive task, to be broken down into smaller discreet parts and distributed across a 
network of heterogeneous machines for simultaneous but independent execution. The 
computing devices performing the processing tasks might include desktop PCs and 
workstations, as well Java based network computers, or machines running a Java OS. 
Using this new type of software architecture, Agentx can potentially simulate the 
functionality of a large mainframe or supercomputer, for only a fraction of the cost. 

Agentx, is targeted for sale to information systems groups within military, 
government, educational and corporate organizations, as well as to independent software 
companies for integration into their own products. 

3. Microsoft Agent by Microsoft Corporation 

Microsoft Agent is a set of programmable software services that supports the 
presentation of interactive animated characters within the Microsoft Windows interface. 
Developers can use characters as interactive assistants to introduce, guide, entertain, or 
otherwise enhance their Web pages or applications in addition to the conventional use of 
windows, menus, and controls. 

Microsoft Agent enables software developers and Web authors to incorporate a 
new form of user interaction, known as conversational interfaces, that leverages natural 
aspects of human social communication. In addition to mouse and keyboard input, 
Microsoft Agent includes optional support for speech recognition so applications can 
respond to voice commands. Characters can respond using synthesized speech, recorded 
audio, or text in a cartoon word balloon. 

The conversational interface approach facilitated by the Microsoft Agent services 
does not replace conventional graphical user interface (GUI) design. Instead, character 
interaction can be easily blended with the conventional interface components such as 
windows, menus, and controls to extend and enhance your application’s interface. 
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Microsoft Agent’s programming interfaces make it easy to animate a character to 
respond to user input. Animated characters appear in their own window, providing 
maximum flexibility for where they can be displayed on the screen. Microsoft Agent 
includes an ActiveX control that makes its services accessible to programming languages 
that support ActiveX, including Web scripting languages such as VisualBasic Scripting 
Edition (VBScript). This means that character interaction can be programmed from 
HTML pages. 

4. Bee-gent by Toshiba Corporation 

Bee-gent is a new type of software development framework in that it is a 100% 
pure agent system. As opposed to other systems that make only some use of agents. Bee- 
gent completely “agent-ifies” the communication that takes place between software 
applications. The applications become agents, and agents carry all messages. Thus, Bee- 
gent allows developers to build flexible open distributed systems that make optimal use 
of existing applications. 

The Bee-gent framework is comprised of two types of agents. “Agent wrappers” 
are used to agentify existing applications, while “mediation agents” support inter- 
application coordination by handling all communications. The mediation agents move 
from the site of an application to another where they interact with the agent wrappers. 
The agent wrappers themselves manage the states of the applications they are wrapped 
around, invoking them when necessary. Thus inter-application coordination is handled 
through the agent wrappers generating and receiving requests, which are transported 
around by the mediation agents. The mediation agents do more than just transport the 
messages; they are able to respond to the nature of the request to determine the best 
course of action. 

5. Cable by Logica Corporation 

Cable is a generic system architecture developed by Logica as part of the GRACE 
Consortium. Cable can be used to develop and execute distributed applications that are 
based on the metaphor of multiple, cooperating intelligent agents. 
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Cable provides the user with an Agent Definition Language (ADL), for defining 
agents, and a parser known as the Scribe, for compiling agent definitions written in ADL 
into agent applications. Agents are developed using ADL and C++. ADL allows 
developers to use Cable without worrying about underlying detail, providing a language 
with a level of abstraction close to that of the agents with which an application is 
designed. Inter-agent communication over a local area network is handled using ORBIX, 
an implementation of the CORBA 2.0 standard. 

6. JATLite developed at Stanford University 

JATLite is a set of Java packages that make it easy to build multi-agent systems 
using Java. JATLite provides a basic infrastructure in which agents register with an 
Agent Message Router facilitator using a name and password, connect/disconnect from 
the Internet, send and receive messages, transfer files, and invoke other programs or 
actions on the various computers where they are running. JATLite facilitates construction 
of agents that send and receive messages using the emerging standard communications 
language, KQML. The communications are built on open Internet standards, TCP/IP, 
SMTP, and FTP. 

7. JATLiteBean developed at University of Otago 

JATLiteBean takes the KQML-speaking functionality of JATLite and wraps it 
into a JavaBean. JATLiteBean provides an easier-to-use interface to JATLite features 
including KQML message parsing, receiving and sending. It provides an extensible 
architecture for message handling and agent "thread of control" management. It also 
supports automatic advertising of agent capabilities to facilitator agents. Also included is 
a generic configuration file parser and KQML syntax checker. 

8. Process Link developed at Stanford University 

The Process Link project is developing an agent-based framework consisting of 
generic agents and a message protocol for integrating multi-disciplinary engineering 
software and for managing distributed design projects. The framework allows developers 
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to wrap legacy software with back-end code that will disturb the existing software 
interface as little as possible while providing useful coordination functions. 

Researchers are using a “weak” agent technology, in which the wrapped software 
become agents that send messages corresponding to interaction semantics. The software 
is not necessarily “smart” and does not conform to any particular theory of agent 
construction. 
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VI. DEVELOPMENT OF THE ACS A SAFETY AGENT 



A. INTRODUCTION 

Technology exists todaj^ that can be used to build software that is intelligent, 
mobile, able to learn, and that can assist humans in dealing with the challenges of 
information overflow. Software can perform tasks that seem inhuman. In seconds, the 
ACSA Safety Agent can examine over 19,000 survey answers and determine which 
answers are four standard deviations outside the average for all answers. A year from 
now, the agent may be able to complete the same task in niicroseconds. The challenge, 
however, is making software that can perform tasks that seem human. Imagine a human 
being that can think as fast as a computer, or imagine a computer that can reason like a 
human being. Imagine not being able to distinguish between the human and the 
computer. Every step made in artificial intelligence, expert systems, information 
systems, processing hardware, and computer programming research takes mankind closer 
to turning such imaginations into reality. 

The primary goal of this thesis was to use the most current technology available to 
build an assistant for conducting organizational safety assessment analysis. All of the 
major software components of this thesis required beta software, which is unsupported 
and undocumented. Beta software reflects either the cutting edge of technology or the 
next generation of a software product. This thesis brings together the latest in Java, 
networks, artificial intelligence, expert systems, software design, and database theory to 
create two significant contributions to the fields of aviation safety and computer science. 
The first contribution is a model for developing intelligent agents. This contribution is 
perhaps the most important contribution, because the model may be used for future 
development that will further advance the field of intelligent agent technology. The 
second contribution is a working application, the ACSA Safety Agent, which 
demonstrates the potential of the model. The ACSA Safety Agent application also 
contributes to the ACSA’s purpose, which is to improve the safety process at the local 
command level and to encourage overall process improvements in all naval aviation 
units. 
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B. 



SOFTWARE DEVELOPMENT PROCESS 



The design and implementation of the ACSA Safety Agent model and application 
followed a relatively simple software development process. The process involved 
requirements analysis, design specification, and implementation. Requirements analysis 
is the process of determining and documenting the user’s needs and constraints, and the 
requirements analysis can be viewed as the design of a set of goals for the proposed 
system [Ref. 9]. Design Specification includes the specification of system functions, 
architecture, and interfaces. Implementation involves building the actual system with 
software by designing and programming software classes in accordance with the design 
specifications. The result should be a software implementation that meets the 
requirements that were identified during the requirements analysis phase. Development 
proceeds somewhat sequentially from requirements analysis to design specifications to 
implementation; however, the three phases may overlap. For example, it may help during 
requirements analysis to produce a prototype model for the user to test, which may help 
the user to discover and articulate system requirements. Phases may also provide 
feedback to previous phases. For example, a new requirement may be discovered during 
the implementation phase. A new requirement will subsequently affect requirements 
analysis and design specifications. Another software development consideration 
concerns evolution, which refers to the fact that the software will require future 
modifications. The user will discover software bugs, and the user’s requirements will 
evolve over time. Both circumstances will require system modifications. The software 
developer will need to conduct the software development process or a portion of the 
process again. Therefore, the development process can be viewed as an iterative, cyclical 
process. 

This thesis produced two software products. One product is a model for 
constructing agents, and the other product is an application that demonstrates how the 
model may be used. The following discussion on requirements analysis, design 
specification, and implementation concerns the development of both products. However, 
not all of the artifacts presented below pertain to both products. If the artifact does not 
pertain to both products, then this fact is indicated in the title of the table or the caption of 
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the figure that contains the artifact. If no such indication is given, then the artifact 
pertains to both products. 

1. Requirements Analysis 

The requirement analysis phase begins with an informal problem statement that 
describes the user’s requirements. The initial problem statement is usually ambiguous, 
incomplete, contradictory, and may not reflect cost considerations; therefore, 
requirements analysis must turn the problem statement into a set of precise and 
measurable requirements [Ref. 9]. The problem statement for the ACSA Intelligent 
Agent is as follows: 

The system will automate some of the tasks involved in analyzing 
data contained in the ACSA database. The system will determine 
assessment scores by organizational safety area and as an overall 
assessment. The data may be horizontally fragmented by respondent and 
squadron attributes. The system will also look for patterns that identify 
anomalies in data entry or in question responses. 



In order to develop precise requirements from the problem statement, several use 
cases were developed. A use case is a narrative that describes the sequence of events for 
an actor (an external agent) using a system to complete a process. Use cases do not 
define requirements, but they illustrate and imply requirements in the stories they tell. 
Functional requirements can then be developed from the use cases. The requirements 
analysis phase produced the following use cases: 
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Table 17: Start System Use Case 



Use Case: Start System 

Actors: User (initiator). System 
Purpose: To start the system 

Overview: The user specifies what set of rules to use and how often to analyze data 
in the database. 







Actor Action 


System Response 


1. The user either double-clicks an icon or 
selects an icon from a menu. 

Table 18: Subset Database Use Case 


2. The system validates the rule set, 
confirms its ability to access the 
database, and notifies the user that it is 
ready. 


Use Case: Subset Database 





Actors: User (initiator). System 
Purpose: To specify what subset of data to use for assessment 
Overview: The user specifies what subset of data will be used for assessing 
aviation safety. 







Actor Action 


System Response 


1. This user indicates to the system that he 
or she wants to specify the database subset. 

3. The user selects attributes from the list. 


2. The system presents a list of 
attributes from the database that 
represents the attributes of the 
respondents and the squadrons. 




4. The system records the subset 
specification for later use. 
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Table 19: Specify System Actions Use Case 



Use Case: Specify System Actions 

Actors: User (initiator), System 
Purpose: To specify what actions the system will take 
Overview: The user specifies what actions the system will take. 


Actor Action 


System Response 


1. The user indicates to the system that he 
or she wants to specify what actions the 
system is to take. 


2. The system presents a set of actions 
that the system is capable of 
performing. 




• The set will include two types 

of actions. One type will be 
conducting safety assessments 
on the specified horizontal 
data subset. The other type 
will be conducting data 
integrity checking of the entire 
database. 

• The set of actions will also 

include the destination of 
results and the frequency of 
action. The results of action 
may be a report, which may be 
printed, saved, displayed, or 
emailed to someone. 


3. The user specifies the actions for the 
system to take. 


4. The system records the specified 
actions for later use. 
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Table 20: Run the System Use Case 



Use Case: Run the system 

Actors: User (initiator). System 
Purpose: To start the system 

Overview: The system is set to run in accordance with the actions that the user has 
previously specified. 



Actor Action 



System Response 



1. This user indicates to the system that the 
system should act in accordance with the 
action that he or she specified earlier. 



2. The system will execute actions in 
accordance with the user’s specified 
action parameters. 



The requirements analysis phase also produces a conceptual diagram of the 
system, which is displayed in Figure 9. The conceptual diagram is further refined 
throughout the development process. The design specification and implementation 
phases will gradually transform the conceptual diagram into a class diagram that is then 
implemented with actual software code. 
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Figure 9: Conceptual Diagram 



The artifacts produced during the requirements analysis phase help the developer 
to create a list of system requirements. The list of requirements will also include system 
constraints. Constraints may include time, money, legal, and hardware limitations. Each 
requirement is identified by a reference number. The reference number facilitates 
requirements management and tracking during future development phases and iterations. 
The requirements analysis phase for the ACSA Safety Agent produced the following list 
of requirements: 

Table 21: System Requirements 



Reference 

Number 


Requirement 


1 


The system must use the same data that is contained in the Automated 
ACSA Survey System database. The system will not require any data that 
is not required for the ACSA survey. The system will use the same 
relational database management system that the Automated ACSA Survey 
System uses. 


2 


The system will access the database over a network. The system must be 
able to access the database, which may be behind a firewall. 


3 


The user must be able to subset the data horizontally by the respondent 
and squadron attributes. 


4 


The system will be able to dynamically adapt to a change in the survey 
questions. If the user modifies the survey by modifying the questions or 
the questionnaire, then the system will not need to be re-programmed to 
reflect the modification. 


5 


The user will be able to modify the rules and the models that the system 
uses to make inferences and conclusions about the data. 


6 


The system will be able to automatically send database analysis results to 
the user. Ideally, an event would trigger the action that notifies the user of 
the event. For example, if the system recognizes a significant anomaly or 
pattern during data analysis, then the user would be notified. The event 
may also be temporal, so that the action is triggered at a specified time. 


7 


The system must be modular in design, so individual components can be 
modified without affecting the rest of the system. 


8 


The system must comply with U.S. Navy and NFS network security 
policies. 


9 


The system must designed and documented in a manner that will assist 
future developers who will continue to develop the system. The code 
should be self-documenting, and useful header comments should be 
included for all classes and methods. 


10 


The system will detect database anomalies that may indicate corrupted 
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data or otherwise erroneous data. See Requirement 5. 


11 


The system will produce summary assessments for aggregate records, 
which are included in the specified horizontal database subset. See 
Requirement 3. 


12 


The system must operate with the following minimum system 
requirements; 

• Windows 9X and NT 

• Pentium 200 MHz processor 

• 32 MB RAM 

• 28.8 Kbps modem 



2. Design Specification 

After determining the system requirements, the development process then enters 
the design specification phase, where a software design that satisfies the requirements is 
developed. The software should be specified in manner that is not specific to any 
particular programming language, but it is helpful to use the syntax of the target language 
if the target language is known in advance. The design specification for the ACSA 
Intelligent Agent uses Java syntax, because a goal of this research is to build the system 
using Java. However, the design specification could be used to implement the system in 
another programming language despite its Java appearance. Design specifications 
describe the system modules and the internal and external interfaces that will satisfy the 
system requirements. The design specification phase produces several artifacts that 
express the design of the system. The artifacts include a detailed architecture, class 
diagrams, state diagrams, and interaction diagrams. Figure 10 presents the application 
architecture. 
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Figure 10: Application Architecture 



3. Implementation 

The system was implemented within the Java Programming Environment. The 
code was written primarily in the Java programming language, as specified in the Java 
1.3 Release Candidate 1 Software Development Kit (JDK 1.3rc01). The inference 
engine was implemented with Jess 4.4, which is an expert system shell written in Java 
and is described in Chapter V. The system eventually was converted to run under Jess 

5.0 beta. The model uses a commercial statistics package from Formanet for statistical 
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analysis. The statistics package is “com.formanet.math.” Unfortunately, the use of this 
package is hard-wired into the model at this time. The agent uses statistical analysis as 
its only data mining modeling tool, so it was conveniently written into the agent model 
during implementation. Future development of the system should remove the statistical 
package from the agent model and include the statistical package in an application 
outside of the agent software package if the package is required. The following Java 
standard extensions were required for developing the application: JavaMail 1.1.3 and 
JavaBeans Activation Framework. Finally, the application uses a trial version of a 
commercial printing package, “com.wildcrest.j2textprinter,” from Wildcrest, Inc. The 
classpath hierarchy is described in Figure 11. Each node beneath the “classpath” node 
in Figure 11 represents a Java package. The agentApp package contains the 
application, and the application package was included in the safetyAgent package solely 
for convenience. 




Figure 11: Classpath Hierarchy 



C. AGENT MODEL 

This thesis produced a model for building software assistants that can help 
researchers analyze the ACSA database. The model, which is shown in Figure 12, does 
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not do anything by itself. Instead, the model is a complete abstraction of the system, 
which describes a framework for building intelligent agents for ACSA database analysis. 




Figure 12: Agent Model 



1. Inference Engine 

The inference engine provides the agent with its reasoning capabilities. The 
inference engine may use conventional programming or artificial intelligence to infer 
knowledge from the data contained in the ACSA database. The type of programming 
style used depends upon the type of problems that the agent is trying to solve. Non- 
structured problems and semi-structured problems are best solved using artificial 
intelligence or expert system shell programming techniques. Conventional programming 
should be used for problems that are structured and have a known algorithm for solving. 
For example, determining the statistical mean and standard deviation for a set of numbers 
does not require artificial intelligence. However, making a recommendation for 
improving the safety climate of an organization may best be solved by using an expert 
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system shell. In practice, the inference engine will probably use a mix of conventional 
programming techniques and artificial intelligence. 

An agent should use models for recognizing patterns and for making conclusions. 
For example, the agent could use a statistical model for recognizing statistical anomalies 
in the database, or the agent could use a predictive model for conducting predictive types 
of analysis. The agent could also use models for recommending mitigation or solutions 
to safety weaknesses that it recognizes in the data. Ideally, the inference engine should 
allow models to be inserted, removed, and modified. The inference engine could rely 
upon a model management system to assist in model management. Such an 
implementation may provide a cleaner design that is modular and easier to modify. 

2. Data Services 

The agent relies upon data and must have access to data. Therefore, the agent 
requires some kind of data service provider. The location, access means, and structure of 
the data will determine how the service is implemented. If all of the data is contained in 
a relational database, then a Java class that uses JDBC may be all that is required. 
However, if the data comes from multiple sources and combines structured and 
unstructured data, then a more sophisticated data access package may be required. The 
data may be internal or external to the system. The data may be contained in a database, 
in reports, in transaction processing systems, or in HTML pages on the World Wide Web 
or an intranet. 

3. Communications Services 

The nature and sophistication of communications services depends upon the 
required capabilities of the agent. If the agent is mobile, collaborates with other agents, 
and collects data from varied sources, then the agent may require a robust 
communications package. However, if the agent acts alone, is implemented in Java, and 
only requires access to a remote relational database, then no additional communication 
services outside of Java’s built-in network application programming interfaces (API) is 
required. 
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4. User Interface 



The agent will need to interact with the user, so the agent requires a user interface. 
The interface should use current human-computer interaction theory to create an interface 
that is relatively easy to use and meets the requirements of the system. The requirements 
may dictate a robust and powerful interface, or the requirements may dictate a simple 
“wizard” type of interface that walks the user through the interaction. 

D. SAFETY AGENT PACKAGE 

1. Safety Agent (safetyAgent.SafetyAgent) 

a. Description 

The safetyAgent.SafetyAgent class is the controlling class for the safety 
agent package. A developer builds an agent by creating an instance of the SafetyAgent 
class and then adding an Inference Engine instance, a DbModule instance, and an 
Options instance to the SafetyAgent instance via public set methods. 

b. Public Interface 

The SafetyAgent class provides only one other method outside of the 
public get and set methods required for its properties. This method is the loadFacts 
method, which takes no parameters and does not return a value. The loadFacts method 
uses the DbModule APIs to extract data from the database, apply statistical analysis 
models (particularly averages and standard deviations) to the data via the 
com.formanet.math package and conventional programming methods, and adds facts to 
the knowledge base. 

2. Inference Engine (safetyAgentJnferenceEngine) 

a. Description 

The Inference Engine provides the reasoning capabilities for the agent. 
The Inference Engine must use some form of knowledge representation and reasoning 
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methodology. The safetyAgent.InferenceEngine implementation uses the Java Expert 
System Shell (Jess) from Sandia Laboratories. Jess is very similar to CLIPS, an expert 
system developed by NASA and written in the C language. 

Jess uses production rules and facts as its knowledge base. Production 
rules are written as if-then rules. The “if’ side of the if-then statement is called the 
conditional statement or the left-hand side (LHS). The “then” side of the if-then 
statement is called the conclusion or the right-hand side (RHS). The LHS is made up of 
facts, or conditional elements (CE), that form a “pattern.” A pattern is matched if all 
conditional elements are true. Jess uses an algorithm known as the Rete Algorithm to 
match LHS conditional elements to facts in the knowledge base. The value of a CE may 
also be the return value of a function. For example, the CE “(test (< ?x 0))” calls a 
function that returns true if the value bound to variable ?x is less than zero. If a pattern 
matches the LHS of a rule, then the rule is “activated.” See Figure 13 for a schematic 
view of the process. 




Knowledge Base 



Figure 13: Making Conclusions 



Although the rule has been activated, nothing will happen. The activated 
rule is simply placed on an agenda and waits for the engine to run. All activated rules 
will execute (“fire”) their RHS when the inference engine runs. A rule can only fire 
once. To re-fire a rule, the facts of the LHS must be removed from the knowledge base 
and then re-asserted as facts into the knowledge base. 
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b. Public Interface 

The inference engine is instantiated with a single parameter, which is a 
reference to the agent to which the engine belongs. The Inference Engine provides the 
following public methods: 

• void loadRulesflnputStream rules) - The method loads a Jess script from an 
input stream. The script must use Jess syntax, and it must declare all 
deftemplates, defclasses, and defrules for the Inference Engine. 

• jess.Value executeCommandfString command) - Commands may be sent 
directly to Jess via this method. The command must be a valid Jess function 
or UserFunction. The return value is the same value that is returned by the 
function that is called by the command string. 

• void storefString name, Object object) - The method provides a convenient 
way to pass Java objects to the Rete engine, so that Jess can access the object 
and its methods. The store method is the same as the Hashtable.put method. 
A stored object may be fetched in Jess and methods from the object’s class 
may be called in Jess. 

• void addFactfObject fact, String tempIateName) - The method adds a 
JavaBean to the knowledge base as a fact using the defclass that has the same 
name as the tempIateName string. 

3. Data Module (safetyAgent.data.DbModule) 

a. Description 

The Data Module is defined as a Java Interface, so the implementing class 
will need to specify how data access is performed. 

b. Public Interface 

The following method signatures are declared by the Safety Module 

interface: 

• Map getAverageByQuestionf int version, DataSelectionCriteria[] criteria) 
throws SQLException - Returns the average answer for each question in the 
questionnaire. The version integer is the version number for the 
questionnaire, and the criteria array describes the database horizontal subset. 
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• DataSelectionCriteria[] getLongitudinalFields (int version) throws 
SQLException - Enables the graphical user interface component to create the 
necessary controls for the user to specify the horizontal subset. 

• int[][] getOutcomes( int version, int questionNumber) - Returns an array 
of all outcomes for the question specified by the questionNumber integer. 
Each row of the array contains a squadron number, a survey number, and the 
answer for that particular survey. 

• SafetyArea[] getSafetyAreas( int version ) - Returns an array of Safety 
Area instances, which, in turn, contain an array of all questions for that safety 
area. This method provides access to all of the survey questions in the 
database. 

4. Questions and Safety Areas (safetyAgent.Question and 
safetyAgent.Safety Area) 

a. Description 

The Question and Safety Area classes are JavaBeans that describe the 
questions and safety areas in the database. The JavaBean properties for these classes 
include properties like question number, text, safety area name, average answer, and 
standard deviation. The Safety Agent class extracts data from the database via the Data 
Module class and creates Question and Safety Area JavaBeans. The Safety Agent class 
then adds the Question and Safety Area JavaBeans to the knowledge base. Jess creates 
“shadow facts” in the Rete engine that are bound to the JavaBeans. Jess uses reflection 
and the java.beans.PropertyChangeSupport class to dynamically change fact slot values 
to match the JavaBeans’ properties. Each set method of a JavaBean must fire a property 
change event, in order to notify Jess that a JavaBean property has changed. 

b. Public Interface 

The public interfaces for the Question and Safety Area classes primarily 
consist of set and get methods. These classes provide a good example on how to use 
JavaBeans as facts in Jess. Both classes instantiate a java.beans.PropertyChangeSupport 
instance as an instance variable, and each get method calls the 
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PropertyChangeSupport.firePropertyChange method to notify all property change 
listeners that a property has been changed. 

5. User Interface Package (safetyAgent.ui.*) 

-The User Interface Package contains implementations of the 
DataSelectorInterface and the QuestionSelectorInterface, which are defined in the 
safetyAgent.data package. These implementations have been included in order to help 
future developers to jumpstart safety agent applications. See Figure 17 for a screen shot 
of the DataSelectionPanel and the QuestionSelectionPanel. The QuestionSelectionPanel 
class implements the QuestionSelectorInterface, and the DataSelectionPanel class 
implements the DataSelectorInterface. These implementation classes primarily use 
JCheckBoxes for the user to select questions and to assign relative weightings per 
questions for assessment purposes and for enabling the user to specify the database 
subset. However, different classes can implement the interface by using different visual 
controls, such as, a JTree class instead of the JPanel and JCheckBox classes. 

E. SAFETY AGENT APPLICATION 

The safety agent application demonstrates how the Safety Agent package may be 
used to create an agent that can help researchers analyze the ACSA database. See Figure 
2 above for a description of the application’s architecture. The application instantiates 
and runs only one agent at a time. However, the Safety Agent package does not limit an 
application to only one agent. In fact, applications could theoretically instantiate and 
operate multiple agents simultaneously. 

The application allows users to create, save, and re-use “profiles.” A profile is a 
set of user preferences that specifies what the agent should do, where the agent should 
send the results, and when the agent should act. 

The application can conduct two types of actions. The first action involves 

assessing the database for organizational safety. The second action involves inspecting 

the database for possible data entry errors. For each type of action, the user must specify 

when and how often the agent should conduct the action. The agent can act once, daily, 

weekly, or monthly. For each type of action, the user must also specify how the agent 
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should report the results of the action. The agent can send the results to the monitor, the 
printer, a file, a set of email addresses, or any combination of these. The agent presents 
the actions’ results as summarized reports that are written in HTML. 

The major system components of the application include the application code, the 
graphical user interface, the data module, the database, and the reports. 

1. Safety Agent App (safetyAgent-agentApp.SafetyAgentApp) 

The Safety Agent App class is the application and contains the main method for 
running the application. The Safety Agent App creates the agent, the database module, 
and the GUI. The application is run from the command line with the following 
command: java safetyAgent.agentApp.SafetyAgentApp. 

2. Application Frame (safetyAgentagentApp.AppFrame) 

The Application Frame (Figure 14) controls the graphical user interface 
components and separates the GUI code from the application code. This class defines all 
actions that are associated with the menu and toolbar. Most actions simply call the 
corresponding method in the Safety Agent App class. However, if the Safety Agent App 
method requires input from the user, such as, a file name for saving the profile, then the 
Application Frame class will handle the user interaction required for getting the input 
from the user. Once the Application Frame has the user’s input, the Application Frame 
instance will typically pass the input to the Safety Agent App instance in a method call. 
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Figure 14: Application Frame 



3. Data Module (safetyAgent,agentApp.DbModule_Survey3_DB) 

The Data Module implements the safetyAgent.DbModule interface and provides 
data services for the agent by connecting and extracting data from the ACSA database via 
Java JDBC. 

4. Database 

The database structure and content is described in Chapter 3, “Database Design.” 
The database can be either on the local machine or accessible via a network connection. 
The file, “safety_agent.properties,” specifies the JDBC connection parameters. The 
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properties file is located in the safetyAgent\agentApp\resources directory. This file may 
be modified, but it should not be moved. 

5. Rules 

The rule file is located in the safetyAgent\agentApp\resources directory. The file 
defines 20 rules and is included in Appendix C. The file may be modified, but should not 
be moved. The following table displays the core rules from the rule file. 



Table 22: Core Rules from Rule File 



Number 


Rule 


1 


(defrule weakness_in_saf ety_area "Weakness in a Safety Area" 
(doRulel) 

(safety_area 

(selected TRUE) 

(name ?safetyArea) 

(avgWtdAnswer ?average) ) 

(test (< ?average 0)) 




(assert (problem_exists_in_safety_area ( 
safetyArea ?safetyArea) ) ) ) 


2 


(defrule overall_weakness "Overall Weakness" 
(doRule2 ) 

( overal l_wtd_average 
(wtdAverage ?average) ) 

(test (< ?average 0) ) 




(assert (overall_problem_exists) ) ) 


3 


(defrule inconsistency_in__saf ety__area "Inconsistent Outcome 
in a Safety Area" 

(do Rules ) 

(question 

(safetyArea ?sa) 

(number ?q) 

(numDeviations ?sd) ) 

(questionAssessmentThreshold 
(threshold ?t) ) 

(test (>= ?sd ?t) ) 




— ^ 

(assert ( inconsistent_outcome_within_saf ety__area 
(safetyArea ?sa) 

( quest ionNumber ?q) ) ) ) 


4 


(defrule saf ety_area_not_consistent_with__overall 

"Safety area(s) is/are not consistent with the overall 
assessment" 

(doRule4 ) 

(safety__area 
(name ?sa) 

(numDeviations ?sd) ) 
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( saf etyAreaAssessmentThreshold 
(threshold ?t) ) 

(test (>= ?sd ?t) ) 




(assert (saf ety_area_not_consistent_with_overall_average 
?sa) ) ) 


5 


(def rule negative_question_assessment 

"The question has a negative weighted average" 
(doRuleS) 

(question 
(number ?n) 

(avgWtdAnswer ?a) 

(text ?txt) ) 

(test (< ?a 0) ) 




— > 

(printout t "Question " ?n ", " ?txt ", has a negative 
assessment. " crlf ) 

( ?*assessmentReport* addWeakQuestion ?n ?txt ?a) ) 



6. Reports 

The agent can produce two types of reports. First, the agent can produce a 
“Database Integrity Report.” This report summarizes the results of the agent’s inspection 
of the database for data entry anomalies. Second, the agent can produce a “Safety 
Assessment Report,” which is shown in Figure 15. 

The assessment report summarizes the results of the agent’s organizational safety 
assessment analysis of either a subset of the database or the entire database. The agent 
can either display, email, print, or save the reports. Time events trigger the actions in this 
implementation of the safety agent application. The user specifies when and how often 
the agent should analyze the database and produce reports by setting the parameters in the 
Options Panel (Figure 16). Details concerning the reports and the models used to 
generate the reports follows in Subsection G below. 

F. INSTALLATION AND OPERATION 

1. Installation 

The application runs on any platform that can run a Java Virtual Machine that 

supports Java Version l.SrcOl. The application also requires the following software: 
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• JavaMail 1.1.2 or higher 

• JavaBeans Activation Framework (JAF) 

• Wildcrest JTextPrinter 2.0 

• Formanet Mathlite 

JavaMail and JAF may be downloaded from the www.javasoft.com website. 
Both packages may be either installed as standard extensions in the jre\lib\ext directory or 
added to the system’s classpath. Since JavaMail and JAF are standard extensions, Sun 
Microsystems recommends installing the packages as standard extensions. The 
application requires JTextPrinter for printing the reports. A trial version of JTextPrinter 
can be downloaded from www.wildcrest.com. The full retail version can be purchased 
for $99.95. Lastly, the application requires Mathlite for calculating averages and 
standard deviations. Mathlite can be purchased from www.formanet.com for $9.95. See 
Figure 11 above for an example classpath hierarchy for installing and running the 
application. 
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2. Operation 



a. Starting the Application 

Start the application from the command line with the command: java 
safetyAgent.agentApp.SafetyAgentApp. This command assumes that the classpath is set 
properly. Instructions for setting the system classpath can be found at 
www.javasoft.com. The application may also be started from a batch file. Some IDEs, 
like Symantec Visual Cafe and IBM VisualAge, will compile Java source code into 
binary executables. However, neither method was tested, since native executable binary 
files are not part of the Java Programming Environment [Ref. 10]. 

b. Create a Profile 

The application starts with a default profile. If the profile will not be 
saved, then simply select Tools Options to modify the default options in the Options 
Panel (Figure 16). If the profile will be used again in the future, then it will be necessary 
to create a new profile by selecting File — > New and following the dialog boxes. 




Figure 16 : Options Panel 
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c. Select Criteria and Questions 

The application uses all records and all questions in the database by 
default. The database, however, may be fragmented horizontally and questions may be 
selected by selecting Tools — > View Selector. The selector panel (Figure 17) displays the 
respondent and squadron attributes in the left-hand panel, and it displays the questions 
and safety areas in the right-hand panel. The relative importance or weighting of a 
question may be adjusted as well by adjusting the slider underneath each question. 
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Figure 17: Selector Panel 

G. ANALYSIS MODELS AND REPORTS 

The initial development of the safety agent system did not develop sophisticated 
models for knowledge building. The research focused primarily on the creation of a 
software model for building agents. Future research may develop additional models for 
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the agent. For the demonstration application, however, a simple analysis model was 
developed and implemented. 

The agent uses statistical analysis and production rules to create an analysis model 
for synthesizing knowledge from survey data. As mentioned previously, the statistical 
analysis model is unfortunately hard-coded in the SafetyAgent class. The 
SafetyAgent.loadFacts method creates JavaBeans for all questions and safety areas in the 
database. The method then extracts information from the database and sets the properties 
of the beans. Both the Question bean and the SafetyArea bean have properties for 
average answers and standard deviations. For safety assessment purposes, this is where 
the hard-coded model stops. The rule file contains the rest of the model for safety 
assessments. However, for database integrity analysis, the loadFacts method contains an 
algorithm for asserting that a survey answer is an anomaly. The method also contains an 
algorithm for asserting that a survey question or a respondent may deserve special 
attention by a researcher. This section will first discuss the model for safety assessment. 
Then this section will discuss the model for database integrity analysis. Lastly, this 
section will discuss the summary reports produced by the application. 

1. Safety Assessment Model Implementation 

The safety agent produces five safety assessments. First, the agent produces an 
overall score and determines if the overall assessment indicates a weak organizational 
safety climate. Second, the agent produces a score for each safety area and determines if 
any safety areas may need improvement. Third, the agent identifies safety areas that are 
inconsistent with the other safety areas. Fourth, the agent determines if any questions 
have received an overall negative response. Finally, the agent identifies questions that 
are inconsistent with the other questions related to the same safety area. The agent uses 
statistical means and standard deviations as model building blocks when conducting these 
five assessments. Model building blocks are functions and routines that may be used 
either alone or as building blocks for constructing larger models [Ref. 2]. In this case, the 
functions that produce the statistical analysis have been combined with conventional 
programming and expert system rules to construct a model for synthesizing safety 
assessment knowledge from raw data. 
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Two factors, however, complicate the use of raw ACS A survey data. First, some 
questions are negatively worded while others are positively worded. This fact means that 
the same answer for two questions may have the same meaning but may also result in an 
opposite evaluation for safety assessment purposes. A “strongly disagree” answer is 
considered a positive response for a negatively worded question, but “strongly disagree” 
is considered a negative response for a positively worded question. Therefore, although 
integer 0 means, “strongly disagree” for all questions, the ramification of integer 0 is not 
the same for all questions. Second, the ACSA Intelligent Agent application allows users 
to adjust the relative importance of each question. The straightforward way to implement 
this capability is to use a visual slider control (see Figure 17) that reduces the average 
answer for a question by a percentage. For example, if a question receives an average 
answer of 5 and its relative importance is 70 percent, then the average answer is reduced 
by 30 percent to 3.5. The problem here is that the reduction of the average answer 
inadvertently changes an “agree” answer into a “disagree” answer. Thus, the meaning of 
the respondent’s answer has been changed, rather than having been reduced in 
significance. 

The agent maps all responses to a common scale that maps the database values -1 
through 6 to -3 through 3. This mapping eliminates the two problems discussed above. 
The following table describes the mappings: 



Table 23: Survey Response Mappings 



ACSA Likert 
Scale 


Meaning 


Positive 

Question 

Mapping 


Negative 

Question 

Mapping 


-1 


N/A 


0 


0 


0 


Strongly Disagree 


-3 


3 


1 


Moderately Disagree 


-2 


2 


2 


Slightly Disagree 


-1 


1 


3 


Neutral 


0 


0 


4 


Slightly Agree 


1 


-1 


5 


Moderately Agree 


2 


-2 


6 


Strongly Agree 


3 


-3 
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The agent uses the statistical software package and conventional programming to 
determine the statistical means and standard deviations for questions, safety areas, and all 
questions together. Questions and safety areas are then asserted as facts into the 
knowledge base, and the Rete engine will fire all rules, in which the facts match patterns 
specified in the LHS. The rules in the knowledge base describe the model. 

The rule file for the demonstration application contains the following rules 
concerning safety assessment (where X is an integer set by the user): 

• If the overall assessment is less than zero, then assert that the overall 
assessment is weak. 

• If a safety area assessment is less than zero, then assert that the safety area 
assessment is weak. 

• If a question’s average answer is less than zero, then assert that the question 
has received a negative assessment. 

• If a safety area’s assessment is X standard deviations outside of the statistical 
mean of all safety area assessments, then assert that the safety area is 
inconsistent. 

• If a question’s average answer is X standard deviations outside of the 
statistical mean of all other questions related to that question’s safety area, 
then assert that the question is inconsistent with the other questions related to 
the same safety area. 

2. Database Integrity Model Implementation 

The safety agent produces three different conclusions concerning database 
integrity. First, the agent determines if any answer in the database is an anomaly. 
Second, the agent determines if any respondent should be considered more interesting 
than the others should. Third, the agent determines if any question should be considered 
more interesting than the others should. The agent uses the following model for 
determining these conclusions (X is defined by the user): 

• If an answer to a question is X standard deviations from the mean for all 
responses for the same question, then this answer is an anomaly. 

• If the database contains more than X anomalous answers for a question, then 
this question is interesting. 
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If a respondent has entered more than X anomalous answers, then this 
respondent is interesting. 






Unlike the if-then statements of the assessment analysis model, the if-then statements for 
the integrity analysis model are not written as rules in the rule file for the Inference 
Engine. Instead, the integrity analysis model is written as conventional if-then statements 
in the SafetyAgent.loadFacts method. However, the conclusions of the if-then statements 
are asserted as facts into the knowledge base, so that additional rules could be written to 
make further conclusions about the interesting questions and respondents. 

3. Explanation of Summary Reports 

The agent can produce an assessment report and a database integrity report. The 
AssessmentReport and IntegrityReport classes extend the abstract safetyAgent.Report 
class. Other concrete reports may be defined in future applications, but all must 
implement the following abstract methods: toString, toHtml, and toXml. All three 
methods return a String that represents the report in plain text, HTML, or XML 
respectively. 

The Safety Agent App uses the toHtml method, so that the reports may be viewed 
in a JTextPane or in a web browser as formatted text. Figure 15 displays an assessment 
report as viewed in a web browser. Writing the reports in HTML makes formatting the 
report much easier than defining a custom StyledDocument class in Java. The report is 
sent in HTML and in plain text when the report is sent via email. The email is sent as a 
multipart MIME with content type set to “text/altemative.” Each report is labeled “For 
Official Use Only” at the top and is entitled “Safety Assessment Report” or “Database 
Integrity Report” accordingly. 

The assessment report includes the following sections: 

• Horizontal Subset - the subset which was used to conduct the safety 
assessment. 

• Summary - a table of assessment scores for the overall assessment and for 
each safety area. Scores ranges from -1 (very negative assessment) to +3 
(very positive assessment). 
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• Overall Negative Assessment - if an overall negative assessment occurs, 
then this section indicates the negative overall assessment in red. 

• Negative Safety Areas - a list of safety areas that received a negative 
assessment. 

• Inconsistent Safety Areas - a list of safety areas that were inconsistent with 
the other safety area assessments. 

• Negative Questions - a list of questions that received a negative assessment. 

• Inconsistent Questions - a list of questions that were inconsistent with the 
other questions belonging to the same safety area. 

The integrity report includes the following sections: 

• Interesting Questions - a list of questions that the Inference Engine has 
determined to be the possible cause of database entry errors. 

• Interesting Respondents - a list of survey respondents that the Inference 
Engine has determined to be the possible cause of database entry errors. 

H. WEAKNESSES OF THE SAFETY AGENT PACKAGE 

The Safety Agent package has two significant weaknesses, which should be 
improved in future development iterations. The model should be a complete abstraction 
of the system [Ref. 11]. The model depicted in Figure 12 is an abstract representation of 
the system, but the model, as implemented in the safety Agent package, is not a complete 
abstraction. 

The SafetyAgent.loadFacts method should not have hard-wired any analysis 
models into the system. Model management, insertion, deletion, and modification should 
be handled in an abstract manner, so that concrete implementations of safety agents can 
define their own models and model management sub-systems. 

The InferenceEngine class is not an abstract class, and the class explicitly ties the 
safety agent’s reasoning module to Jess, production rules, and the Rete algorithm. 
Therefore, the implementation precludes the use of other knowledge representation 
schemes and reasoning methods. 
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I. 



AREAS FOR FUTURE RESEARCH 



1. Knowledge Engineering 

The quality and sophistication of the agent’s reasoning capabilities relies upon 
how well knowledge has been modeled and implemented. The first step in modeling 
knowledge is to elicit knowledge from from human experts. Knowledge engineering is 
defined as: 

The art of bringing the principles and tools of AI research to bear 
on difficult applications problems requiring experts’ knowledge for their 
solutions. The technical issues of acquiring this knowledge, representing 
it and using it appropriately to construct and explain lines of reasoning are 
important problems in the design of knowledge-based systems. The art of 
constructing intelligent agents is both part of and an extension of the 
programming art. It is the art of building complex computer programs that 
represent and reason with knowledge of the world. [Ref. 12] 

The analysis models and the rules for the agent must be improved. Future 
research could involve interviewing aviation safety experts and eliciting expert 
knowledge. Models and rules can then be built that express this expert knowledge and 
then added to a model package within the safetyAgent package. Likewise, future 
research could also involve developing a model management sub-system for the agent. 

2. Agent Technology 

The demonstration application currently deploys only one agent, but the 
safetyAgent package does not limit the number of agents that an application can deploy. 
Future research can explore how multiple agents could be used in the system. In fact, 
future research could explore many of the different facets of agent technology. Research 
could be conducted on mobile agents, collaborating agents, and learning agents. Future 
research could simply improve the rudimentary agent characteristics of the current agent. 

3. Applications Development 

The demonstration application could be used as the basis for developing a more 
robust ACSA Intelligent Agent application. The rule list could be extended to make use 
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of intermediate conclusions and to make conclusions that are more powerful. More 
actions, such as event-triggered alerts, could be implemented. The user interface could 
be studied and improved. The code, algorithms, and queries could be optimized to 
perform faster and more reliably. 
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APPENDIX A. AGENT MODEL SOURCE CODE 



A. SOURCE CODE: safetyAgent.SafetyAgent.java 



/* 

* Title: 

* Version: 

* Copyright: 

* Author: 

* Project: 

* Description; 

* 

*/ 



SafetyAgent .java 

1.0 

Copyright (c) All Rights Reserved. 

Rusl Flowers and David Dowler 
Thesis 

This is the core class for creating and running 
an ACSA Safety Agent . 



package safetyAgent; 

import j ava . i o . * ; 
import java. util.*; 
import com. formanet .math .* ; 
import safetyAgent .data.*; 



y ★ ★ 

* This is the core class for creating and running an ACSA Safety 
Agent . 

* The safety agent requires an Inference Engine, a DbModule, a 

* QuestionSelectionInterface, a DataSelectionInterface , an Options 
instance 

* describing the user's preferences, and a Properties instance 

* containing an integer for " threshold . interesting_questions " 

* and an integer for " threshold. interesting_respondents" . 

* 

* ^author Rusl Flowers 

* ©author David Dowler 

* ©version 1.0 
*/ 

public class SafetyAgent { 

y ★ ★ 

* Default Constructor. Must set all of the agent's properties 

* before using. Otherwise, null pointer exceptions will result. 

*/ 

public Saf etyAgent ( ) { } 

y ★ ★ 

* Constructs the agent with everything it needs to get the job done. 
*/ 

public SafetyAgent (DbModule dbm, QuestionSelectionInterface qsi, 
DataSelectionInterface dsi. Properties props. Inf erenceEngine 
engine. 

Options defaultOptions, Options userOptions) { 
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setDbModule (dbm) ; 

setQuestionSelectionInterface (qsi) ; 
setDataSelectionInterface (dsi) ; 
setProperties (props) ; 
setInferenceEngine (engine) ; 
setDefaultOptions (defaultOptions) ; 
setUserOptions (userOptions) ; 

} 

public void setProperties (Properties props) { 
properties = props; 

} 

public void setDbModule (DbModule dbModule) { 
this. dbModule = dbModule ; 

} 

public void setDataSelectionInterf ace (DataSelectionInterf ace dsi) { 
this . dataSelector = dsi; 

} 

public void setQuestionSelectionInterface (QuestionSelectionInterface 
qsi) { 

this . questionSelector = qsi; 

} 

public void setInferenceEngine (Inf erenceEngine engine) { 
this. engine = engine; 

} 

public void setUserOptions (Options options) { 
userOptions = options; 

} 

public void setDefaultOptions (Options options) { 
defaultOptions = options; 

} 

public Options getUserOptions ( ) { 
return userOptions; 

} 

public DbModule getDbModule ( ) { 
return dbModule; 

} 

public DataSelectionInterface getDataSelector ( ) { 
return dataSelector; 

} 

public QuestionSelectionInterface getQuestionSelector ( ) { 
return questionSelector; 

} 
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public Options getDef aultOptions ( ) { 
return def aultOptions ; 

} 

public Inf erenceEngine getinf erenceEngine ( ) { 
return engine; 

} 

public void setRules ( InputStream rules) { 
engine . loadRules ( rules ) ; 

} 

public Report [] getReports ( ) { 
return reports; 

} 

public void setReport (Report [ ] reports) { 
this. reports = reports; 

} 



! -k-k 

* Creates and loads facts into the inference engine's knowledge base. 

* Retrieves question and safety area information from the DbModule, 

* creates Question and SafetyArea beans, sets the beans' properties 

* based on the data from the DbModule and from statistical analysis, 
and 

* then adds the beans as facts to the knowledge base. 

* <p> 

* * Note: Questionnaire version number is set to 1. This was done to 
save 

* time. Since there is currently only one questionnaire version and 
no plans 

* to create a new version anytime soon, this built-in inflexibility 

* and ergo bad design was seen acceptable for rapid development. 

*/ 

public void loadFacts(){ 

//debug 

System. out .println(”\n” + new java . util . Date ( ) + Loading 
Facts ..."); 

try { 

engine . executeCommand ( 

" (assert (questionAssessmentThreshold " + 

" (threshold " + 

userOptions . getQuestionAssessmentThreshold ( ) + ”)))"); 

engine . executeCommand ( 

" (assert ( safetyAreaAssessmentThreshold " + 

" (threshold " + 

userOptions . getSafetyAreaAssessmentThreshold ( ) + ")))"); 
SafetyArea safetyArea[] = questionSelector . getSaf etyAreas ( ) ; 
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/* 

* The following two vectors are used for determining the 

* statistical means and std. deviations for the overall 

* weighted answer and scaled answer, respectively. 

*/ 

Vector overallWtdAnswerVector = new Vector (); 

Vector overallScaledAnswerVector = new Vector (); 

Map averageAnswers = dbModule . get Aver ageByQuest ion ( 

1, dataSelector . getDataSelectionCriteria ( ) ) ; 

Hashtable quest ionAnoma lies = new Hashtable(); 

Hashtable respondent Anomalies = new Hashtable (); 



for (int i = 0; i < safetyArea . length; i++) { 

/* 

* All data is analyzed by safety area, so this is a double nested 

loop 

* where the outer loop iterates through the safety areas and the 

* inner loop iterates through the questions for each safety area. 

* Furthermore, the inner loop is actually conducted twice. Once for 

* assessment and once for integrity checking. The integrity 
checking 

* loop contains the second nested loop, which iterates through all 
of the 

* answers for a particular question. 

*/ 



SafetyArea sArea = saf etyArea [ i] ; 

Question [] questions = sArea . questions () ; 

//debug 

System. out .println (" \nLoading Facts for " + sArea . getName ( ) + 



Vector avgScaledAnswerVector = new Vector (); 

Vector avgWtdAnswerVector = new Vector (); 
boolean selected = false; 

for (int j = 0; j < questions . length; j++) { 

String qNumber = (new 

Integer (questions [ j ] .getNumber ( ) ) ) . toString ( ) ; 

float avg = ( (Float ) averageAnswers . get (qNumber ) ) .floatValueO; 

questions [j] . set Avg Answer ( Math . round (avg) ) ; 

engine . addFact (questions [ j ] , "question" ) ; 

avgScaledAnswerVector . add ( 

new Double (questions [ j ] . getAvgScaledAnswer ( ) )) ; 
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if (questions [j ] . isSelected ( ) ) { 

avgWtdAnswerVector . add ( 

new Double (questions [j] . get AvgWtdAnswer ( ) ) ) ; 

if ( ! sArea . isSelected ( ) ) { 
sArea. setSelected( true) ; 

} 

} 

} //end of first question loop 

sArea . setAvgScaledAnswer (Math. round ( (float) 

new FStatistics (avgScaledAnswerVector) .getMean() ) ) ; 

sArea . setStdDeviation ( 

new FStatistics (avgScaledAnswerVector) . getStandardDeviation ( ) ) 

overallScaledAnswerVector . add ( 

new Double ( sArea . getAvgScaledAnswer ( ) ) ) ; 

if (avgWtdAnswerVector . size ( ) > 0) { 
sArea . set AvgWtdAnswer ( 

new FStatistics (avgWtdAnswerVector) .getMeanO ) ; 
overallWtdAnswerVector . add ( 

new Double ( sArea . get AvgWtdAnswer ( ) ) ) ; 



for (int k = 0; k < questions . length; k++) { 

/* 

* Must loop through the questions again for integrity checking. 

* Integrity checking could have been done during the first loop, 

* but I separated it out because I will want to move this into a 

* another method later. 

*/ 

/ / debug 

System. out .print ( 

" integrity checking for question " + 
questions [k] . get Number ( ) + " "); 

if (questions [k] . isSelected ( ) && 
sArea . get StdDeviation ( ) > 0) { 
questions [k] . setNumDeviat ions ( 

(Math. abs ( 

sArea . getAvgScaledAnswer ( ) - 
questions [k] . getAvgScaledAnswer ( ) ) ) / 
sArea. gets tdDeviation ( ) ) ; 

} 

int[][] outcomeTuples = dbModule . getOut comes ( 

1 , questions [k] . getNumber ( ) ) ; 

Vector outcomes = new Vector(); 

for (int p = 0; p < outcomeTuples . length; p++) { 
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outcomes . add (new Double (outcomeTuples [p] [2] ) ) ; 

} 

double expectedOutcome = new FStatistics (outcomes) . getMean () ; 
double deviation = new 

FStatistics (outcomes) . getStandardDeviation ( ) ; 

questions [k] . setStdDeviation ( deviation ); 

// Loop through all of the outcomes for this question 
for (int q = 0; q < outcomeTuples . length; q++) { 

double ans = outcomeTuples [q] [2 ] ; 

double ansVariance = Math. abs (ans - expectedOutcome); 
double numDev = 0; 

if (deviation > 0) { 

numDev = (ansVariance / deviation) ; 

) 

if (numDev >= userOptions . getintegri tyThreshold ( ) ) { 

//debug 

System. out . print ("*") ; // creates a histograph for 

anomalies 



int quest ionNumber = questions [k] . getNumber () ; 
int surveyNumber = outcomeTuples [q] [ 0] ; 
int squadronNumber = outcomeTuples [q] [ 1 ] ; 

engine . executeCommand ( 

” (assert" + 

" (outcome_is_anomaly " + 

" (quest ionNumber " + quest ionNumber + ")" + 

" ( surveyNumber " + surveyNumber + " ) " + 

" (squadronNumber " + squadronNumber + ")))"); 

String questionKey = Integer . toString (questionNumber) ; 
if (questionAnomalies . containsKey (questionKey) ) { 
Integer frequencyl = 

(Integer) questionAnomalies . remove (questionKey) ; 

frequencyl = new Integer ( frequencyl . intValue ( ) + 1); 
questionAnomalies . put (questionKey , frequencyl) ; 

) 

else { 

questionAnomalies . put (questionKey , new Integer(l)); 



String respondentKey = 

Integer . toString (squadronNumber) + " " + 

Integer . toString ( surveyNumber) ; 
if (respondentAnomalies . containsKey (respondentKey) ) { 
Integer frequency2 = 

(Integer) respondentAnomalies . remove (respondentKey) ; 
frequency2 = new Integer ( frequency2 . intValue ( ) + 1) ; 
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respondentAnomalies .put { respondent Key , frequency2 ) ; 

} 

else { 

respondentAnomalies .put (respondent Key, new Integer(l)) 

) 

} 

) // end of outcomesTuple loop 
//debug 

System.out.printlnO ; 

} // end of second questions loop 
engine. addFac t (sArea, " saf ety_area" ) ; 

}// end of safety areas loop 

Enumeration keys = quest ionAnoma lies . keys {) ; 
while (keys . hasMoreElements ( ) ) { 

String key = (String) keys . nextElement {) ; 

Integer freq = ( Integer ) quest ionAnomalies . get (key ) ; 
if (freq. intValue( ) >= 

Integer .parseint (properties . get Property ( 

" threshold. interest ing_questions" ) ) ) { 
engine . executeCommand ( 

" (assert" + 

" ( interest ing_question__anomaly" + 

" (quest ionNumber " + key + ")" + 

"(frequency " + f req . intValue ( ) + ")))"); 

) 

} 

Enumeration keys2 = respondentAnomalies . keys () ; 
while (keys2 . hasMoreElements ( ) ) { 

String key2 = (String) keys2 .nextElement ( ) ; 

Integer freq2 = ( Integer) respondentAnomalies . get (key2 ) ; 
if ( freq2 . intValue ( ) >= 

Integer . parseint (properties . get Property ( 

"threshold. interesting_respondents" ) ) ) { 

StringTokenizer tk = new StringTokenizer (key2 ) ; 
int sqdrnNumber = Integer . parseint ( tk . nextToken ( ) ) ; 
int svyNumber = Integer . parseint ( tk . nextToken ( ) ) ; 
engine . executeCommand ( 

" (assert" + 

" ( interest ing_respondent_anomaly" + 

" ( su 2 rveyNumber " + svyNumber +- " ) " + 

" ( squadronNumber " + sqdrnNximber + " ) " + 

" ( frequency " + f req2 . intValue ( ) + " )))"); 

) 

} 

if (overallWtdAnswerVector . size ( ) > 0) { 
engine . executeCommand ( 

" (assert (overall_wtd_average " + 

" (wtdAverage " + 
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new FStatistics (overallWtdAnswerVector) . getMean ( ) + ")))”); 

} 

double overallScaledAverage = 

new FStatistics (overallScaledAnswerVector) . getMean () ; 

for (int m = 0; m < safetyArea . length; m++) { 

saf etyArea [m] . setNumDeviations ( 

(Math . abs ( 

safetyArea [m] . getAvgScaledAnswer ( ) - overallScaledAverage) ) / 
new 

FStatistics (overallScaledAnswerVector) . getStandardDeviation { ) ) ; 

} 

} catch ( java . sql . SQLException ex) { 
ex .print StackTrace { ) ; 

} 

//debug 

System. out .println (new java .util . Date ( ) + Completed loading 

facts . \n" ) ; 

} 



! -k -k 

* Runs the Jess engine and resets the fact list afterwards. 
*/ 

public void runJessO { 

//debug 

System. out .println ( "\nThe engine is running.Xn"); 

engine. execut eCommand ( " (assert (doRulel) ) ") ; 
engine. execut eCommand ( " (assert (doRule2 ) )"); 
engine. execut eCommand ( " (assert (doRuleS ) )"); 
engine . executeCommand ( " (assert (doRule4) )"); 
engine . executeCommand ( " (assert (doRuleS ) )"); 
engine .executeCommand( " (assert (doRuleS) ) ") ; 

ReportOptions assessRptOpt = 

userOptions . getAssessmentReport Options ( ) ; 

ReportOptions integrityRptOpt = 

userOptions . getDatabaseIntegri tyReportOptions ( ) ; 

ReportOptions [ ] rOption = {assessRptOpt, integrityRptOpt}; 
String [] rptName = ("assessment", "integrity"}; 

for (int i = 0; i < 2; i++) { 

/* 

* Asserts the report options as facts into the 

* knowledge base. 

*/ 



ReportOptions opt = rOption[i] ; 
String rName = rptName [i]; 
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if (opt .getEmail ( ) ) { 

String [ ] address = opt . get Email Address ( ) ; 

StringBuffer command = 

new StringBuff er (" (assert (emails” + rName + "_report(to "); 
for (int k = 0; k < address . length; k++) { 
command. append ( address[k] + " " ); 

} 

command . append (")))"); 

engine . executeCommand ( command . toStr ing ( ) ) ; 



if (opt .getPrint ( ) ) { 

engine . executeCommand (" (assert (print_" + rName + "_report))") 

} 

if (opt .getSaveAsFile ( ) ) { 

engine. execut eCommand (" (assert (save_" + rName + "^report ) ) " ) ; 

} 

if (opt . getDisplayToScreen ( ) ) { 

engine . executeCommand (" (assert (display_" + rName + 

"^report) ) ") ; 

} 

) 

engine . executeCommand ( " (run) " ) ; 

System. out .println (" \n\nResetting ... clearing all facts"); 
engine . executeCommand ( " (reset) " ) ; 



} 



) 



private 

private 

private 

private 

private 

private 

private 

private 



DbModule dbModule; 

QuestionSelectionInterface questionSelector; 
DataSelectionInterface dataSelector ; 
Properties properties; 

Inf erenceEngine engine; 

Options defaultOptions; 

Options userOptions; 

Report [ ] reports ; 



B, SOURCE CODE: safetyAgentJnferenceEngine 



/* 

* Title: 

* Version: 

* Copyright : 

* Author: 

* Project: 



Inf erenceEngine . j ava 

1.0 

Copyright (c) All Rights Reserved. 
Rusl Flowers and David Dowler 
Thesis 
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* Description: Conducts reasoning for the Safety Agent 
*/ 

package saf etyAgent ; 

import jess.*; 
import java.io.*; 
import javax. swing.*; 



^ ★ 

* Conducts reasoning for the Safety Agent. 

★ 

* ©author Rusl Flowers 

* ©author David Dowler 

* ©version 1.0 
*/ 

public class Inf erenceEngine { 

private Rete rete; 
private SafetyAgent parent; 

public Inf erenceEngine ( final SafetyAgent parent ) { 

this. parent = parent; 
rete = new Rete{); 
try { 

rete . executeCommand { 

"(printout t \"The ACSA Agent is listening ... \ " crlf)") 
/ / re te . executeCommand { " (watch all) " ) ; 

rete . addUserpackage (new MiscFunctions ( ) ) ; 
rete . addUserpackage (new Ref lectFunctions ( ) ) ; 

//String scriptFile = 

(Rete .class . get Re source ( " scriptlib. clp" ) ) .getFile ( ) ; 

/ /rete . executeCommand (” (batch " + scriptFile + ")"); 
rete . store ( " agent " , parent ) ; 

) 

catch (Exception e) { 
e . printStackTrace ( ) ; 

} 

) 

public void store( String name. Object obj ){ 
rete . store (name, obj ) ; 

■} 

/** 

* Parses a Jess script into the engine 

* 

* ©param rules The Jess script 
*/ 

public void loadRules ( InputStream rules ) { 
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Jesp parser = new Jesp(new Inputs treamReader (rules ) , rete) 
try{ 

parser .parse (false) ; 

} 

catch (Exception e) { 
e . printStackTrace ( ) ; 

} 



public Value executeCommand (String command) { 
try{ 

return (rete. executeCommand (command) ) ; 

} 

catch (JessException e) { 

e . printStackTrace ( ) ; 

Exception ex = (Exception)e.getNextExceptionO; 
if ( e I = null ) { 

System. out .println( "++++ Nested Exception +++++"); 
ex . printStackTrace ( ) ; 

} 

return null; 

} 

} 

! -k-k 

* Adds an object, typically a JavaBean, to the fact list. 

★ 

* @param fact The bean 

* (iparam templateName The deftemplate name for the bean 
*/ 

public void addFact (Obj ect fact. String templateName) { 
try { 

Funcall f = new Funcall ( "def instance" , rete) ; 

f. add (new Value (templateName, RU.ATOM) ) ; 
f . add (new Value ( fact ) ) ; 

f . execute ( rete , getGlobalCont ext ( ) ) ; 

} 

catch (JessException e) { 

System. err. println(e.getMessage() ) ; 
e .printStackTrace ( ) ; 

} 

} 

! k k 

* Pretty-prints the fact list 
*/ 

public String ppFacts(){ 
return rete .ppFacts ( ) ; 

} 



} 
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c 



SOURCE CODE: safetyAgentdata.DbModule 



Title : 
Version; 
Copyright : 
Author : 
Project : 
Description: 



DbModule . j ava 

1.0 

Copyright (c) All Rights Reserved. 

Rusl Flowers and David Dowler 
Thesis 

Declares database services required for the Safety Agent 



V 



package saf etyAgent . data ; 

import java. util.*; 
import j ava . sql . * ; 
import saf etyAgent . * ; 

/ * * 

* Declares database seirvices required for the safety agent. 

★ 

* Aversion 1.0 

* ©author Rusl Flowers 

* ©author David Dowler 
*/ 

public interface DbModule { 

/ ★ ★ 

* Returns the safety areas and their questions 
*/ 

public SafetyArea[] getSaf etyAreas ( int version) 
throws SQLExcep t ion ; 



^ ★ 

* The order of the returned array is guaranteed to be indexed 

* to the array of questions passed in. 



* ©param questions 

* ©param criteria 

* 

respondents . 

*/ 



The questions 

Longitudinal subset of respondents. Can be null, 
which will return the average for all 



public Map getAverageByQuestion ( int version, 

DataSelectionCriteria [ ] criteria) throws SQLException; 



/ ★ ★ 

* Returns an array of arrays where, for each row, index 0 

* is the Su 2 Tvey_ID, index 1 is the Squadron_ID, and index 2 

* is the answer. 

* 

* ©param version questionnaire version 

* ©param quest ionNumber The question number 
*/ 
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public int[][] getOutcomes { int version, int quest ionNumber) 
throws SQLException; 



j -k -k 

* Returns any array of respondent and squadron attributes 

* 

* @param version questionnaire version number 
*/ 

public DataSelectionCriteria [ ] getLongitudinalFields { int version) 
throws SQLException; 

} 



D. SOURCE CODE: safetyAgent.Question 



/* 

* Title: 

* Version: 

* Copyright : 

* Author: 

* Project: 

* Description: 

* 

fact . 

* 

property 
* 

•k 

*/ 

package saf etyAgent ; 

! ~k "k 

* Survey question bean encapslates information 

* regarding a suirvey question. Jess uses the bean as a fact. 

* Bean attributes are treated as slots by Jess, and property 

* change support and listeners are added to enable Jess to 

* track any changes to the bean's attributes. 

* 

* Aversion 1.0 

* ©author Rusl Flowers 

* ©author Dave Dowler 

*/ 

public class Question { 

private int number = 0 ; 

private String text = "not assigned" ; 

private String safetyArea = "not assigned"; 

private float weight; 

private boolean selected; 

private boolean positive = true; 

private int avgAnswer = -1111; //-llll means "never initialized" 

private double stdDeviation; 



Question . java 
1.0 

Copyright (c) All Rights Reserv’ed. 

Rusl Flowers and David Dowler 
Thesis 

Survey question bean. Encapslates all of the information 
regarding a suirvey question. Jess uses the bean as a 

Bean attributes are treated as slots by Jess, and 

change support and listeners are added to enable Jess to 
track any changes to the bean's attributes. 
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private double numDeviations ; 
public QuestionOn 

public Question{int num. String txt, boolean pos) { 
setNumber (num) ; 
setText (txt) ; 
setPositive (pos) ; 



public boolean isSelected { ) { 
return selected; 

} 

public float getWeight{){ 
return weight; 

} 

public int ge t Number {) { 
return number; 

) 

public String getText { ) { 
return text; 

) 

public String getSaf etyArea { ) { 
return saf etyArea; 

} 

public boolean isPosi tive { ) { 
return positive; 

} 

public int getAvgAnswer { ) { 
return avgAnswer; 

} 

/ * * 

* Maps Likert scale used by the ACSA Survey to a common scale 

*/ 

public int getAvgScaledAnswer ( ) { 
switch (avgAnswer) { 



case 0 


return isPositive ( ) ? -3 


3; 


case 1 


return isPosi tive ( ) ? -2 


2; 


case 2 


return isPositive () ? -1 


1; 


case 4 


return isPosi tive () ? 1 


-1; 


case 5 


return isPositive () ? 2 


-2; 


case 6 


return isPositive () ? 3 


-3; 


default: return 0; 





) 

} 

public double get AvgWtdAnswer ( ) { 

return (getAvgScaledAnswer ( ) * weight); 

} 

public double getStdDeviation ( ) { c 

return stdDeviation; 

} 

public double getNumDeviations ( ) { ‘‘ 

return numDeviations; 

} 
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// Set Methods // 

// Fires property changes to notify Jess Rete engine of changes// 

public void setSelected (boolean newValue) { 
boolean tmp = selected; 
selected = newValue; 

pcs . f irePropertyChange (" selected" , tmp, selected) ; 

} 

public void setNumber ( int newValue) { 
int tmp = number; 
number = newValue; 

pcs . f irePropertyChange ( "number " , tmp, number) ; 

} 

public void setText (String newValue) { 

String tmp = text; 
text = newValue; 

pcs . f irePropertyChange (" text " , tmp, text) ; 

} 



public void setSafetyArea ( String newValue) { 

String tmp = safetyArea; 
safetyArea = newValue; 

pcs . f irePropertyChange ( "safetyArea" , tmp, safetyArea) ; 

} 



public void setWeight ( float newValue) { 
float tmpl = weight; 
double tmp2 = getAvgWtdAnswer ( ) ; 
weight = newValue; 

pcs . f irePropertyChange ( "weight " , new Float(tmpl), 

new Float (weight ) ) ; 

pcs . f irePropertyChange ( "avgWtdAnswer " , new Double ( tmp2 ) , 

new Double (getAvgWtdAnswer ( ) ) ) ; 



} 



public void setPositive (boolean newValue) { 
boolean tmp = positive; 
positive = newValue; 

pcs . f irePropertyChange ( "positive" , tmp, positive) ; 



public void setAvgAnswer ( int newValue) { 
int tmpl = getAvgScaledAnswer ( ) ; 
int tmp2 = avgAnswer; 
double tmp 3 = getAvgWtdAnswer ( ) ; 
avgAnswer = newValue; 

pcs . f irePropertyChange ( "avgScaledAnswer" , tmpl, 
getAvgScaledAnswer ( ) ) ; 

pcs . f irePropertyChange ( "avgAnswer" , tmp2 , avgAnswer) ; 
pcs . f irePropertyChange ( "avgWtdAnswer" , new Double ( tmp3 ) , 

new Double (getAvgWtdAnswer ( ) ) ) ; 
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} 



public void setStdDeviation (double newValue) { 
double tmp = stdDeviation; 
stdDeviation = newValue; 

pcs . f irePropertyChange ( "StdDeviation" , new Double (tmp) , 

new Double (stdDeviation) ) ; 



} 



public void setNumDeviat ions (double newValue) { 
double tmp = numDeviations; 
numDeviations = newValue; 

pcs . f irePropertyChange ( "numDeviations" , new Double (tmp) , 

new Double (numDeviations)); 



} 



// Property Change Support and Listeners for Jess 

private java .beans . PropertyChangeSupport pcs = 
new java. beans. PropertyChangeSupport (this) ; 

public void 

addPropertyChangeListener (java . beans . PropertyChangeListener pci ) { 
pcs . addPropertyChangeListener (pci ) ; 

} 

public void 

removePropertyChangeListener (java .beans . PropertyChangeListener pci) { 
pcs . removePropertyChangeListener (pci ) ; 

} 

) 



E. SOURCE CODE: safetyAgent.SafetyArea 



/* 

* Title: 

* Version: 

* Copyright : 

* Author: 

* Project: 

* Description: 

* 

as a fact. 

★ 

property 



*/ 



Saf etyArea . java 
1.0 

Copyright (c) All Rights Reserved. 

Rusl Flowers and David Dowler 
Thesis 

Organizational safety assessment area bean. Encapslates 
safety assessment area information. Jess uses the bean 

Bean attributes are treated as slots by Jess, and 

change support and listeners are added to enable Jess to 
track any changes to the bean's attributes. 



package safetyAgent; 
import java .util . * ; 
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/ ★ ★ 

* Organizational safety assessment area bean. Encapsulates 

* safety assessment area information. Jess uses the bean as a fact. 

* Bean attributes are treated as slots by Jess, and property 

* change support and listeners are added to enable Jess to 

* track any changes to the bean's attributes. 

* 

* ©version 1.0 

* ©author Rusl Flowers 

* ©author Dave Dowler 

*/ 

public class SafetyArea { 



private String name; 

private int avgScaledAnswer ; 

private double avgWtdAnswer ; 

private double stdDeviation; 

private double numDe via t ions; 

private boolean selected; 

private Vector questions = new Vector* 



public SafetyArea ( ) { 

} 



public SafetyArea (String name) { 
setName ( name ) ; 

} 



public void addQuestion (Question q) { 
questions . add (q) ; 

} 



public boolean isSelected( ) {return selected;} 
public String getName () (return name;} 

public int getAvgScaledAnswer () (return avgScaledAnswer;} 
public double ge t AvgWtdAnswer () (return avgWtdAnswer;} 
public double getNumDeviations () (return numDeviations ; } 
public double getStdDeviation () (return stdDeviation;} 
public Question [] questions () { 

return (Question [] ) questions . toAr ray (new 
Question [questions . size {)]);} 



// Set Methods // 

// Fires property changes to notify Jess Rete engine of changes// 



public void setSelected (boolean newValue) ( 
boolean tmp = selected; 
selected = newValue; 

pcs . f irePropertyChange (" selected" , new Boolean (tmp) , 

new Boolean (selected)); 



} 



public void setName ( String newValue) { 
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} 



String tmp = name; 
name = newValue; 

pcs . f irePropertyChange { "name" , tmp, name) ; 



public void setAvgScaledAnswer {int newValue) { 
int tmp = avgScaledAnswer; 
avgScaledAnswer = newValue; 

pcs . f irePropertyChange ( "avgScaledAnswer " , new Integer(tmp) , 

new Integer (avgScaledAnswer)); 



} 



public void setAvgWtdAnswer (double newValue) { 
double tmp = avgWtdAnswer ; 
avgWtdAnswer = newValue; 

pcs . f irePropertyChange ( "avgWtdAnswer " , new Double (tmp), 

new Double (avgWtdAnswer) ) ; 



} 



public void setNumDeviat ions (double newValue) { 
double tmp = numDeviations; 
numDeviations = newValue; 

pcs . f irePropertyChange ( "numDeviations" , new Double(tmp), 

new Double (numDeviations)); 



} 



public void setStdDeviation (double newValue) { 
double tmp = stdDeviation; 
stdDeviation = newValue; 

pcs . f irePropertyChange (" StdDeviation" , new Double(tmp), 

new Double ( StdDeviation) ) ; 



} 



// Property Change Support and Listeners for Jess 

private j ava . beans . PropertyChangeSuppor t pcs = 
new j ava. beans . Proper tyChangeSupport (this) ; 

public void 

addPropertyChangeLis tener ( j ava . beans . PropertyChangeListener pci ) { 
pcs .addPropertyChangeListener (pci) ; 

} 

public void 

removePropertyChangeLis tener (java .beans . PropertyChangeListener pci) { 
pcs . removePropertyChangeListener (pci) ; 

} 

} 
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APPENDIX B. SAFETY AGENT APPLICATION SOURCE CODE 



A. SOURCE CODE: safetyAgent.agentApp.SafetyAgentApp 



/* 

* Title: 

* Version: 

* Copyright : 

* Author: 

* Project: 



Saf etyAgentApp . java 

1.0 

Copyright (c) All Rights Reserved. 
Rusl Flowers and David Dowler 
Thesis 



* Description: The Safety Agent Application 
*/ 



package saf etyAgent . agentApp ; 

import j avax . swing . * ; 
import j ava . awt . event . * ; 
import j ava . awt . * ; 
import j ava . io . * ; 
import java. util . * ; 
import saf etyAgent . ui . * ; 
import saf etyAgent . data ; 
import saf etyAgent . * ; 

import com. wildcrest . j2 textprinter . * ; 

import j avax .mail.*; 

import j avax .mail . internet .* ; 

I it * 

* The safety agent application. 

★ 

* ©version 1 . 0 

* ©author Rusl Flowers 

* ©author David Dowler 
*/ 

public class Saf etyAgentApp { 

private Saf etyAgent agent = new SafetyAgent ( ) ; 
private AppFrame frame; 
private JDialog optionsDialog; 
private Properties props = new Properties!); 
private j avax . swing . Timer timer; 

public Saf etyAgentApp ( ) { 

try { 

UIManager . setLookAndFeel ( 

UIManager . getSystemLookAndFeelClassName ( ) ) ; 

} 

catch (Exception e) { 
e . printStackTrace { ) ; 

} 
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//new Thread (new SplashFrame ()). start (); 



try { 

props . load ( 

Saf etyAgentApp . class . getResourceAsStream ( 

" resources/ safe ty_agent .properties” ) ) ; 

agent . setProperties (props) ; 

agent . setDbModule (new DbModule_Survey3_DB (props) ) ; 
agent . setDataSelectionInterf ace (new DataSelectionPanel (agent ) ) ; 
agent . setQuestionSelectionInterface (new 
QuestionSelectionPanel (agent) ) ; 

agent . setInferenceEngine (new Inf erenceEngine (agent) ) ; 
agent . setRules ( 

Saf etyAgentApp. class. getResourceAsStream ( "resources/rules . clp” ) ) ; 
agent . setUserOptions (new Options ( ) ) ; 
agent . setDef aultOptions (new Options ( ) ) ; 
agent . getinf erenceEngine ( ) . store ( " agentApp " , this ) ; 

frame = new AppFrame(this); 
frame .validate ( ) ; 

frame . addWindowListener (new WindowAdapter ( ) { 

public void windowclosing ( WindowEvent e ) { 

System. exit ( 0) ; 

} 

}) ; 

//Center the window 
Dimension screenSize = 

Toolkit . getDefaultToolkit ( ) . getScreenSize ( ) ; 

Dimension frameSize = frame . getSize () ; 
if ( frameSize .height > screenSize . height ) { 
frameSize . height = screenSize . height ; 

} 

if ( frameSize .width > screenSize .width) { 
frameSize .width = screenSize .width; 

} 

frame . setLocation ( (screenSize . width - frameSize .width) / 2, 
(screenSize. height - frameSize . height ) / 2); 

frame . setVisible ( true) ; 



catch (lOException ioe) { 
ioe . printStackTrace ( ) ; 

JOptionPane . showMessageDialog 

(null, "Unable to load \ ” safety_agent .propertiesX " file.", 
"Error" , JOptionPane . ERR0R_MES SAGE) ; 

System. exit (0) ; 

} 

catch (ClassNotFoundException cnf ) { 
cnf .printStackTrace ( ) ; 

JOptionPane . showMessageDialog 



122 



(null, "Unable to find JDBC driver class. Check the 
" \ " jdbc . driverX " property setting in the " + 

" \ "safety_agent .properties \ " f ile . " , 

"Error" , JOptionPane . ERROR_MESSAGE) ; 

System. exit ( 0 ) ; 

} 



} 

public static void main ( String [ ] args) { 

SafetyAgentApp app = new Saf etyAgentApp () ; 

} 

public SafetyAgent getAgent () { 
return agent; 

} 

public void runAgent ( ) { 



public void createProf ile ( ) { 

} 

public void openProfile( String fileName 1 throws 
FileNotFoundException, lOException { 

Properties profile = new PropertiesO; 

prof ile . load (new FileInputStream ( fileName) ) ; 

String profileName = prof ile . getProperty ( "prof ileName" ) 

// Thresholds 

int integrityThreshold = Integer . parseint ( 
prof ile . getProperty (" integrityThreshold" ) ) ; 
int safetyAreaAssessmentThreshold = Integer .parseint ( 
profile . getProperty ( " safetyAreaAssessmentThreshold" ) ) 
int questionAssessmentThreshold = Integer . parseint ( 
prof ile . getProperty ( "questionAssessmentThreshold" ) ) ; 

// Assessment Report Options 
int aReport_frequency = Integer . parseint ( 
prof ile. getProperty ( "aReport_frequency" ) ) ; 
int aReport_nthDay = Integer .parseint ( 
prof ile. get Proper ty( "aReport_nthDay" ) ) ; 
int aReport_weekDay = Integer .parseint ( 
prof ile . getProperty ( "aReport_weekDay" ) ) ; 
int aReport_blankOf EveryMonth = Integer .parseint ( 
prof ile . getProperty ( "aReport_blankOf EveryMonth" ) ) ; 
int aReport_of EveryBlankMonths_l = Integer .parseint ( 
prof ile . getProperty (" aReport_of EveryBlan3cMonths_l " ) ) ; 
int aReport_ofEveryBlankMonths_2 = Integer . parseint ( 
prof ile. getProperty ( "aReport_ofEveryBlankMonths_2" ) ) ; 



int aReport_blankDays = Integer .parseint { 
prof ile . get Property ( "aReport_blankDays " ) ) ; 
int aReport_everyBlankWeeks = Integer .parseint { 
prof ile . getProperty ( "aReport_everyBlankWeeks " ) ) ; 

String [] aReportAddressArray = parseEmailAddresses ( 
prof ile. getProperty ( "aReport_emailAddress" ) ) ; 

String aReport_nameOf SaveFile = 

prof ile. getProperty { "aReport_nameOf SaveFile" ) ; 
boolean aReport_email = 

new Boolean (prof ile . getProperty { "aReport_email ") ) . booleanValue { ) ; 
boolean aReport_print = 

new Boolean (prof ile. getProperty { "aReportj>rint" ) ) . booleanValue { ) ; 
boolean aReport_saveAsFile = 
new 

Boolean (prof ile . getProperty { "aReport_saveAsFile" ) ) . booleanValue ( ) ; 
boolean aReport_displayToScreen = 
new Boolean { 

profile. getProperty { "aReport_displayToScreen" ) ) .booleanValue { ) ; 
boolean aReport_selected = 
new 

Boolean (profile . getProperty ( "aReport_selected" ) ) .booleanValue ( ) ; 

// Integrity Report Options 
int i Rep ort_ frequency = Integer . parseint ( 
profile . getProperty ( " iReport_f requency " ) ) ; 
int iReport_nthDay = Integer . parseint ( 
prof ile . getProperty (" iReport_nthDay" ) ) ; 
int iReport_weekDay = Integer .parseint ( 
profile . getProperty ( " iReport_weekDay " ) ) ; 
int iReport_blankOfEveryMonth = Integer . parseint ( 
prof ile. getProperty ( " iReport_blankOf EveryMonth" ) ) ; 
int iReport_ofEveryBlankMonths_l = Integer . parseint ( 
prof ile . getProperty (" iReport_ofEveryBlankMonths_l" ) ) ; 
int iReport_ofEveryBlankMonths_2 = Integer . parseint ( 
profile . getProperty ( " iReport_of EverYBlankMonths_2 " ) ) ; 
int iReport_blankDays = Integer . parseint ( 
prof ile . getProperty ( " iReport_blankDays " ) ) ; 
int iReport_everyBlankWeeks = Integer .parseint ( 
profile. getProperty ( " iReport_everyBlankWeeks" ) ) ; 

String [] iReportAddressArray = parseEmailAddresses ( 
profile . getProperty ( " iReport_emailAddress " ) ) ; 

String iReport_nameOf SaveFile = 

profile . getProperty ( " iReport_nameOf SaveFile" ) ; 
boolean iReport_email = 

new Boolean (prof ile . getProperty (" iReport_email " ) ) .booleanValue ( ) ; 
boolean iReport_print = 

new Boolean (prof ile. getProperty ( "iReport_print" ) ) .booleanValue ( ) ; 
boolean iReport_saveAsFile = 
new 

Boolean (prof ile. getProperty ( "iReport_saveAsFile" ) ) .booleanValue ( ) ; 
boolean iReport_displayToScreen = 
new Boolean ( 

prof ile. getProperty ( "iReport_displayToScreen" ) ) .booleanValue ( ) ; 
boolean iReport_selected = 
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new 

Boolean (prof ile. getProperty ( "iReport_selected" ) ) . booleanValue ( ) ; 

// If 

// Set Options // 

// // 

Options options = agent . getUserOptions {) ; 
options . setlntegrityThreshold(integrityThreshold) ; 

options . setSaf etyAreaAssessmentThreshold (saf etyAreaAssessmentThreshold) 



options . setQuestionAssessmentThreshold (quest ionAssessment Threshold) ; 

ReportOptions aOptions = options . getAssessmentReportOptions {) ; 

aOptions . setSelected (aReport_selected) ; 

aOptions . setFrequency (aReport_frequency) ; 

aOptions . setBlankDays ( aRepor t_blankDays ) ; 

aOptions . setEveiryBlankWeeks ( aRepor t_eve 2 ryBlankWeeks) ; 

aOptions . setNthDay ( aRepor t_nthDay) ; 

aOptions . setWeekDay ( aReport_weekDay) ; 

aOptions . setBlankOfEveiryMonth (aRepor t_blankOfEveryMonth) ; 
aOptions . setOf EveryBlankMonths_l ( aRepor t_o fEveryBlankMonths_l ) ; 
aOptions . se t Of Every BlankMonths_2 (aReport_of EveryBlankMonths_2 ) ; 
aOptions . setSaveAsFile (aReport_saveAsFile) ; 
aOptions . set Print (aReport_print) ; 
aOptions . setEmail (aReport_email) ; 

aOptions . setDisplayToScreen ( aRepor t_displayToScreen) ; 
aOptions . setNameOfSaveFile (aRepor t_nameOfSaveFile) ; 
aOptions . setEmailAddress (aReportAddressArray) ; 

ReportOptions iOptions = 
options . getDatabaseIntegrityReportOptions ( ) ; 
iOptions . setSelected ( iReport_selected) ; 
iOptions . setFrequency ( iReport_f requency ) ; 
iOptions . setBlankDays ( iReport_blankDays) ; 
iOptions . setEveiryBlankWeeks ( iReport_everyBlankWeeks) ; 
iOptions . setNthDay ( iReport_nthDay ) ; 
iOptions , setWeekDay ( iReport_weekDay ) ; 

iOptions . setBlankOf EveiryMonth ( iReport_blankOf EveryMonth) ; 
iOptions. setOf EveryBlankMonths_l ( iReport_ofEve 2 ryBlankMonths_l) ; 
iOptions . set0fEveryBlankMonths_2 ( iReport_of EveryBlankMonths_2 ) ; 
iOptions . setSaveAsFile ( iReport_saveAsFile) ; 
iOptions . setPrint ( iReport_print ) ; 
iOptions . setEmail ( iReport_email) ; 

iOptions . setDisplayToScreen ( iReport_displayToScreen) ; 
iOptions . setNameOfSaveFile ( iReport_nameOf SaveFile) ; 
iOptions . setEmailAddress ( iReportAddressArray) ; 

frame . setCurrentProf ileName (prof ileName) ; 



} 

public void saveProfile( String f ileName ) throws 
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FileNotFoundException, lOException { 

Options options = agent . getUserOptions () ; 

Properties profile = new Properties(); 

prof ile . setProperty { "prof ileName" , f rame . getCurrentProf ileName ( ) ) ; 

profile . setProperty ( " integrityThreshold" , 

Integer . toString (options . getIntegrityThreshold ( ) ) ) ; 

profile . setProperty ( " safetyAreaAssessment Threshold" , 

Integer .toString (options. getSafetyAreaAssessmentThresholdO ) ) ; 

profile . setProperty ( "questionAssessment Threshold" , 

Integer. toString (options. getQuestionAssessmentThresholdO ) ) ; 

ReportOptions aReport = options.getAssessmentReportOptionsO; 

Report Opt ions iReport = 
options . getDatabaseIntegrityReportOptions ( ) ; 

String [] reportName = {"aReport", "iReport"}; 

ReportOptions [ ] reportOption = {aReport, iReport}; 

for (int i = 0; i <= 1; i++) { 

prof ile . setProperty (reportName [ i] + "^selected", 

new Boolean (reportOption [i] . isSelected( ) ) . toString ( ) ) ; 
prof ile . setProperty (reportName [i] + "^frequency" , 

Integer. toString (reportOption [i] . getFrequency ( ) ) ) ; 
prof ile. set Property (reportName [i] + "_nthDay" , 

Integer .toString (reportOption [i] .getNthDayO ) ) ; 
prof ile . setProperty (reportName [i] + "_weekDay" , 

Integer . toString (reportOption [i] . getWeekDay ( ) ) ) ; 
profile . setProperty (reportName [i] + "_blankOf EveryMonth" , 
Integer. toString (reportOption [i] . getBlankOf EveryMonth ( ) ) ) ; 
prof ile . setProperty (reportName [i ] + "_ofEveryBlankMonths_l" , 
Integer . toString (reportOption [i] . getOf EveryBlankMonths_l ( ) ) ) ; 
profile . setProperty ( reportName [ i ] + "_of EveryBlankMonths_2 " , 
Integer . toString ( reportOption [ i] . getOf EveryBlankMonths_2 ( ) ) ) ; 
prof ile . setProperty ( reportName [ i ] + "_blankDays " , 

Integer . toString ( reportOption [ i ] . getBlankDays ( ) ) ) ; 
profile. setProperty (reportName [i] + "_everyBlankWeeks" , 

Integer . toString (reportOption [i] . getEveryBlankWeeks ( ) ) ) ; 

String[] email Addresses = reportOption [ i] . get EmailAddress () ; 
StringBuffer buffer = new StringBuf f er ( ) ; 

for (int j = 0; j < emailAddresses . length; j++) { 
buffer .append (emailAddresses [ j ] ) ; 
if (j != (emailAddresses . length - 1) ) { 
buffer . append ( " ; " ) ; 

} 

} 

profile . setProperty (reportName [ i ] + 

"_emailAddress" , buffer. toString( ) ) ; 

profile . setProperty (reportName [ i] + "_nameOf SaveFile" , 
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reportOption[i] . getNameOf SaveFile ( ) ) ; 
profile . setProperty (reportName [ i] + "_email " , 

(new Boolean (reportOpt ion [i] .getEmail ( ) ) ) . toString( ) ) ; 
profile. setProperty (reportName [i] + "_print " , 

(new Boolean ( report Option [i] . get Print ( ) ) ) . toString ( ) ) ; 
profile. setProperty (reportName [i] + "_saveAsFile" , 

(new Boolean (reportOpt ion [i] .getSaveAsFile ()) ) .toString()); 
prof ile . setProperty ( reportName [ i] + "_displayToScreen" , 

(new 

Boolean (reportOption[i] . getDisplayToScreen ( ) ) ) . toString ()) ; 

} 

profile . store ( 

new FileOutputStream ( f ileName) , 
frame. getCurrentProfileName ( ) ) ; 



public void mail(Report report, String[] to) { 

String from = props . get Property ( "email . from" ) ; 

String subject = report . getTi tie ( ) + " " + 
report . getDate ( ) . toString ( ) ; 

Properties mailProps = new Properties () ; 

String smtpHost = props . get Proper ty (" email . host ") ; 
mailProps .put ( "mail . smtp .host " , smtpHost) ; 

Session session = Session . getDefaultInstance (mailProps , null); 
session . setDebug ( true) ; 

try { 



InternetAddress [ ] addresses = new InternetAddress [ to. length ] 

for ( int i = 0; i < to. length; i++) { 

addresses [ i ] = new InternetAddress ( to[i] ); 

} 

Message message = new MimeMessage ( session ); 

message . setFrom ( new InternetAddress ( from ) ); 

message. setRecipients (Message. RecipientType . TO, addresses) ; 

message . setSubject ( subject ); 

message . setSentDate ( new Date() ) ; 

MimeBodyPart mbpl = new MimeBodyPart ( ) ; 

mbpl . setContent (report . toString ( ) , "text /plain" ) ; 

MimeBodyPart mbp2 = new MimeBodyPart ( ) ; 

mbp2 . setContent (report . toHtml ( ) , " text/html " ) ; 

Multipart mp = new MimeMultipart ( "alternative" ) ; 
mp . addBodyPart (mbpl ) ; 
mp . addBodyPart (mbp2 ) ; 
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message . setContent (mp) ; 
Transport . send ( message ) ; 

} 

catch (MessagingException mex) { 
mex.printStackTrace ( ) ; 

) 



public void display (Report report) { 

JTextPane pane = new JTextPane ( ) ; 

pane . setContentType ( " text /html ” ) ; 

pane . setEditable ( false) ; 

pane . setText (report . toHtml ( ) ) ; 

JFrame frame = new JFrame ( "report ") ; 
JScrollPane sPane = new JScrollPane(pane); 
frame.getContentPane ( ) .add(sPane) ; 
frame. setSize(600, 700) ; 
frame . show ( ) ; 



public void print (Report report) { 

JTextPane pane = new JTextPaneO; 
pane . setContentType ( "text /html") ; 
pane . setEditable ( false) ; 
pane. setText (report . toHtml ( ) ) ; 

j2TextPrinter j2tp = new J2TextPrinter ( ) ; 
j 2 tp . setPrintDialogUsed ( false) ; 
j 2 tp . setSeparatePr intThread ( false ) ; 
j2tp.setLeftMargin(l) ; 
j2tp.setRightMargin(l) ; 
j2tp. setTopMargin (1) ; 
j2tp.setBottomMargin(l) ; 
j2tp.setBoxAroundHeader( false) ; 

j 2 tp. print (pane) ; 

} 

public void save (Report report) { 

String fileName = "report.html"; 

if ( report instanceof AssessmentReport ) { 
fileName = 

agent . getUserOptions ( ) . getAssessmentReportOptions ( ) . 
getNameOf SaveFile ( ) ; 

} 

else { 

fileName = 
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agent . getUserOptions ( ) . getDatabaseIntegrityReportOptions ( ) . 
getNameOf SaveFile ( ) ; 

} 

try { 

PrintWriter writer = new PrintWriter (new 
FileOutputStream( f ileName) ) ; 

writer .println (report . toHtml ( ) ) ; 
if (writer. checkError( ) ) { 

System. out .println ( "Error writing file."); 

} 

} 

catch (lOException e) { 
e . printStackTrace ( ) ; 

} 



public void exit(){ 

System. exit ( 0 ) ; 

} 

private String [] parseEmailAddresses ( String addressString ){ 

StringTokenizer tk = new StringTokenizer (addressString, 
int numberOf Addresses = tk. countTokens ( ) ; 

String!] addressArray = new String [numberOf Addresses] ; 

try { 

for (int i = 0; i < numberOf Addresses ; i++) { 
addressArray [i ] = tk . nextToken ( ) ; 

} 

} 

catch (NoSuchElementException nse) { 
nse. printStackTrace ( ) ; 

} 

return addressArray; 

} 



} 



B. SOURCE CODE: safetyAgentMgentApp,DbModule_Survey3jDB 



/* 

* Title: 

* Version: 

* Copyright: 

* Author: 

* Project: 

* Description: 
*/ 



DbModule_Survey3_DB . j ava 

1.0 

Copyright (c) All Rights Reserved. 

Rusl Flowers and David Dowler 
Thesis 

Provides database services for the Safety Agent 
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package saf e tyAgent . agentApp ; 

import j ava . sql . * ; 
import java. util.*; 
import saf etyAgent . * ; 
import saf etyAgent . data . * ; 



y ★ ★ 

* Provides database services for the Safety Agent 

* 

* ©author Rusl Flowers 

* ©author David Dowler 

* ©version 1.0 
*/ 

public class DbModule_Survey3_DB implements DbModule { 

private static String url; 
private static String user; 
private static String password; 

public DbModule_Survey3_DB( Properties p) throws 
C 1 a s sNo t FoundExc ep t i on { 

Class . forName (p . getProperty ( " jdbc . driver" ) ) ; 
url = p . getProperty (" jdbc .url ") ; 
user = p . getProperty (" jdbc .user ") ; 
password = p . getProperty ( "jdbc .password" ) ; 

} 

y ★ * 

* Returns the safety areas and questions from the database 

* Defaults to version number 1, so the parameter is not used in 

* this version. 

*/ 

public final SafetyArea[] getSafetyAreas ( int version) 
throws SQLException{ 

String fromClause = 

"FROM Questions INMER JOIN Questions_Questionnaires ON " + 
"Questions . Quest ion_ID = Questions_Questionnaires . Question_ID 



String whereClause = 

" Quest ions_Ques tionnaires . Questionnaire_Version = 1 "; 

String saf etyAreaQuery = 

"SELECT Questions . Saf ety_Area " + fromClause + 

" GROUP BY Questions . Saf ety_Area, " + 

" Questions_Questionnaires . Questionnaire_Version " + 
" HAVING " + whereClause; 

Vector tempV = new Vector(); 

Connection conn = getConnection ( ) ; 
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statement stmt = conn . createStatement ( ) ; 

ResultSet rs = stmt . executeQuery ( safe tyAreaQuery) ; 

while (rs .next ( ) ) { 

String saf etyAreaName = rs . getString ( 1) / 

SafetyArea sa = new Saf etyArea ( saf etyAreaName) ; 

Statement stmt2 = conn. createStatement () ; 

ResultSet rs2 = s tmt 2 . executeQuery ( 

"SELECT Questions .Question__ID, Questions . Quest ion_Text , " + 

" Questions . Is_Positive " + fromClause + 

" WHERE " + whereClause + " AND " + 

" Questions . Saf ety_Area = '" + saf etyAreaName + 

while (rs2 .next ( ) ) { 

Question q = new Question ( 

rs2 .getint (1) , rs2 .getString (2) , rs2 . getBoolean (3 ) ) ; 
q. set Saf etyArea ( saf etyAreaName ); 
sa.addQuestion(q) ; 

} 

tempV.add(sa) ; 

} 

conn . close ( ) ; 

return (Saf etyArea []) tempV. to Array (new Saf etyArea [tempV. size ()] ) ; 



public final Map getAverageByQuestion (int version, 

DataSelectionCriteria [ ] criteria) throws SQLException{ 



StringBuffer query = new StringBuf f er ( 

"SELECT Answers . Quest ion_ID, Avg (Answers .Answer ) AS AvgOf Answer 

"FROM Respondents INNER JOIN " + 

"(Squadrons INNER JOIN " + 

" (Answers INNER JOIN " + 

" Quest ions_Questionnaires ON Answers . Quest ion__ID = " + 

" Quest ions__Quest ionnaires . Quest ion_ID) " + 

"ON Squadrons . Squadron__ID = Answers . Squadron_ID) " + 

"ON (Respondents . Squadron_ID = Answers . Squadron_ID) " + 

"AND (Respondents . Survey_ID = Answers . Survey_ID) "); 



query . append ( " GROUP BY Answers . Quest ion__ID, " + 

"Quest ions_Questionnaires . Questionnaire_Version ") ; 

if (criteria i= null) { 

Vector tempV = new Vector (); 
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for (int i = 0; i < criteria . length; i++) { 

String fieldName = 

criteria[i] .getTableName ( ) + + 

criteria[i] . getFieldName ( ) ; 

if ( tempV. contains (fieldName) ) { 
continue; 

} 

else { 

tempV.add(f ieldName) ; 
query . append ( ” , "); 
query. append (fieldName) ; 
query . append ( " ” ) ; 

) 

} 

} 

StringBuffer havingClause = new StringBuf f er ( 

" HAVING ( ( (Questions_Questionnaires . Questionnaire_Version) =1 ) 

") ; 



if (criteria != null){ 

for (int i = 0; i < criteria . length; i++) { 
havingClause . append ( " AND " ) ; 
havingClause . append ( " ( ( " + 

criteria [i] . getTableName ( ) + " . ” + criteria [i] . getFieldName ( ) + 
”) = '" + criteria [i ]. getEqualTo ( ) + "')"); 
havingClause . append ( " " ) ; 

} 

) 

query. append (havingClause + ")"); 

Map result = new TreeMapO; 

Connection conn = getConnection ( ) ; 

Statement stmt = conn . createStatement ( ) ; 

ResultSet rs = stmt . executeQuery( query . toString ()) ; 

while (rs .next ( ) ) { 
result .put ( 

rs . getString ( "Question_ID” ) , new 
Float (rs . getFloat ( " AvgOf Answer " ) ) ) ; 

} 

return result; 



public final int[][] getOutcomes ( 
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int version, int questionNumber ) throws SQLException { 

Connection conn = getConnection ( ) ; 

Statement pstmt = conn . createStatement ( ) ; 

Vector tempV = new Vector(); 

ResultSet rs = pstmt . executeQuery ( 

"SELECT Answers . Survey_ID, Answers . Squadron_ID, Answers . Answer " 

+ 

"FROM (Questions INNER JOIN Answers ON " + 

"Questions .Question_ID = Answers . Question_ID) INNER JOIN " + 

" Quest ions_Questionnaires ON Questions . Quest ion_ID = " + 
"Questions_Questionnaires . Question__ID " + 

"WHERE (( (Answers. Question_ID) = " + questionNumber + ") AND " + 

" ( (Questions_Questionnaires .Questionnaire__Version) = " + version + 

"))’•); 



while (rs .next ( ) ) { 

tempV.add(new int [ ] {rs . getint ( 1) , rs . getint ( 2 ) , rs . getint ( 3 ) } ) / 

} 

return (int [ ] [ ] ) tempV. toArray (new int [tempV. size ( ) ] [3] ) / 

} 



/** 

* Implements DbModule interface, and only returns fields, to which 

* a Respondent record is related. For example, if no 

* respondent is a Marine, then USMC will not be included in the 

* fields. 

*/ 

public final DataSelectionCriteria [ ] getLongitudinalFields ( int 
version) 

throws SQLException { 

Vector result = new Vector (); 

String [] squadronFields = ("Community", "Location"); 

String [] respondentFields = ("Rank", "Designator", "Status", 

" Service" } ; 

Connection conn = getConnection () ; 

for (int i = 0; i < squadronFields . length; i++) { 

Statement stmt = conn . createStatement ( ) ; 

ResultSet rs = stmt . executeQuery ( 

"select " + squadronFields [ i] + " from Squadrons inner join " + 
"Respondents on Squadrons . Squadron_ID = Respondents . Squadron_ID 

" + 

"group by " + squadronFields [ i] ) ; 

II V . add ( squadronFields [ i ] ) ; 
while (rs . next ( ) ) { 
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result .add(new DataSelectionCriteria ( 

squadronFields [ i] , "Squadrons ", rs . getString ( 1) , false) ) ; 

} 

rs. close 0 ; 

} 

for (int i = 0; i < respondentFields . length; i++) { 

Statement stmt = conn . createStatement ( ) ; 

ResultSet rs = stmt . executeQuery ( 

"select " + respondentFields [i] + " from Respondents inner join 

" + 

" Squadrons on Squadrons . Squadron_ID = Respondents . Squadron_ID " 

+ 

"group by " + respondentFields [i] ) ; 

// V. add( respondentFields [i] ) ; 
while (rs .next ( ) ) { 

result . add (new DataSelectionCriteria ( 

respondentFields [i] , "Respondents", rs . getString ( 1 ) , false)); 

} 

rs . close ( ) ; 

} 

conn . close ( ) ; 

return (DataSelectionCriteria [ ] ) result . toArray ( 
new DataSelectionCriteria [result . size ( ) ] ) ; 

} 

private static final Connection getConnection ( ) throws SQLException { 
return DriverManager . getConnection (url , user , password) ; 

} 
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APPENDIX C. JESS RULE FILE 



; Title: rules. clp 
; Version: 

; Author: Rusl Flowers and David Dowler 

; Description: Defines the rules for the Safety Agent App 



/ / 

; load JavaBean class definitions 



//////////////////////#/////////// 



(defclass question safetyAgent . Question) 
(defclass safety_area saf etyAgent . SafetyArea) 



/ / 

; Defglobals 






(defglobal ?*assessmentReport * = (new safetyAgent . AssessmentReport ) ) 
(defglobal ?*integrityReport * = (new safetyAgent . IntegrityReport ) ) 



; Deftemplates 

////////////////////////////////// 



(def template safetyAreaAssessmentThreshold 
(slot threshold) ) 

(def template quest ionAssessmentThreshold 
(slot threshold)) 

(def template overall_wtd_average 

"The overall average for weighted averages" 

(slot wtdAverage) ) 

(def template problem_exists_in_safety_area 
"A problem exists in a safety area" 

(slot safetyArea) ) 

(def template inconsistent_outcome_within__saf ety_area 
(slot safetyArea) 

(slot quest ionNumber) ) 

(def template outcome_is_anomaly 
(slot quest ionNumber) 

(slot surveyNumber ) 

(slot squadronNumber) ) 

(def template interest ing_question_anomaly 
(slot quest ionNumber) 
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(slot frequency)) 



(def template interesting_respondent_anomaly 
(slot suirveyNumber ) 

(slot squadronNumber) 

(slot frequency) ) 

(def template quest ionAssessmentThreshold 
(slot threshold)) 

(def template safetyAreaAssessmentThreshold 
(slot threshold)) 

(deft emp late ema i l_a s se s smen t_r ep or t 
(multislot to) ) 

(def template email_integrity_report 
(multislot to) ) 



; Rule 1: Weakness in a Particular Safety Area 
//////////////////////////////////////////////// 



; If doRule is true and a selected safety area's average weighted 
answer 

; is less than zero, then assert that a problem exists in that 
particular 
; safety area. 



(def rule weakness_in_saf ety_area "Weakness in a Safety Area" 

(doRulel) 

( saf ety_area 

(selected TRUE) 

( name ? sa f e tyAr ea ) 

(avgWtdAnswer ?average) ) 

(test (< ?average 0) ) 

=> 

(assert (problem_exists_in_safety_area (saf etyArea ?safetyArea) ) ) ) 

; If a problem exists in a safety area, then print to the screen "The 
; average weighted answer for safety area X is Y. Therefore, a safety 
; problem may exist in safety area X. 

(defrule saf ety_area_problem_action "Do this if a problem is found” 
(problem_exists_in_safety_area 
(saf etyArea ?sa) ) 

(saf ety_area 
( name ? sa ) 

(avgWtdAnswer ?avg) ) 
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= > 



(printout t "The average weighted answer for " ?sa " is 
(printout t "Therefore, a safety problem may exist in " 
( ?*assessementReport addWeakArea ?sa ?avg) ) 



" ?avg crlf) 
?sa) 



/ i 

; Rule 2 ; Overall Weakness 



t t t ! f ! t t t I t t t t t t ! I ! t i t t t t t ! t t t i 



/ / 

; If doRule is true and the overall assessment is less than zero, then 
; assert that an overall problem exists. 
/////////////////////////////////////////////////////////////////////// 



(defrule overall_weakness "Overall Weakness" 

(doRule2 ) 

( overall_wtd_average 
(wtdAverage ?average) ) 

(test (< ?average 0)) 

=> 

(assert (overall_problem_exists) ) ) 

/ / 

; If an overall problem exists, then print to the screen, "The overall 
; average is X. Therefore, a general safety problem may exist." 

I t t ! t t f t t t t ! t t t ! t t t ! t t t t t ! f ! f t t I ! t t t t ! t t t t t f t ! t I t II I $ ! t i f ! t f t t t i t t t f t t t 

! / 



(defrule overall_problem_action "Do this if an overall problem is 
found" 

( overall_problem_exists ) 

( overall_wtd_average 
(WtdAverage ?average) ) 

=> 

(printout t "The overall average is " ?average crlf) 

(printout t "Therefore, a general safety problem may exist" crlf) 
( ?*assessmentReport* addWeakOverall ?average) ) 



/ / 

; Rule 3: Inconsistent Outcome within a Safety Area 



II II II II II II II II II II II II II II II II II II II II II II II II II II II II II II ! 



; If doRule3 is true and a question's average scaled answer is two or 
; more standard deviations from its safety area's average scaled 
answer, then 

; assert that the question is inconsistent with the other questions 
; in that particular safety area. 

'iiiii^iiiiiiiiiiiiiiiii*iiiiiii)iiiiiiiiit]itt]]iittiiiiiiitiiiiiii^itii 
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(defrule inconsistency_in_saf ety_area "Inconsistent Outcome in a Safety 
Area " 

(doRuleS ) 

(question 

(safetyArea ?sa) 

(number ?q) 

(numDeviations ?sd) ) 

( quest ionAssessmentThreshold 
(threshold ?t) ) 

(test (>= ?sd ?t) ) 

-> 

(assert ( inconsistent_outcome_within_saf ety_area 
(safetyArea ?sa) 

(questionNumber ?q) ) ) ) 



; If a question is inconsistent with the other questions in its safety 
area, 

; then print to the screen, "Question X is inconsistent with the other 
; questions in safety area Y. " 

/////////////////////////////////////////////////////////////////////// 



(defrule inconsistent_outcome_in_saf ety_area_action "Do this if a 
question 

is inconsistent with its safety area's average answer" 

( inconsistent_outcome_within_safety_area 
(safetyArea ?sa) 

(questionNumber ?q) ) 

(question 
(number ?q) 

(text ?txt) 

(avgWtdAnswer ?q_avg) ) 

(safety_area 
(name ?sa) 

(avgWtdAnswer ?sa_avg) ) 

=> 

(printout t 

"Question " ?q "'s average is inconsistent with other questions in 
" ?sa crlf) 

( ?*assessmentReport* addInconsistentQuestion ?q ?txt ?q_avg ?sa 
?sa_avg) ) 



Rule 4: Safety Area(s) not Consistent with Overall Average 
///////////////////////////////////////////////////////////////// 



; If doRule4 is true and a safety area's average scaled answer is two 
or 

; more standard deviations from the overall average scaled average, 
then 



138 



; assert that the safety area's average outcome is inconsistent with 
the 

; overall average outcome 



(def rule safety_area_not„consistent_with_overall 

"Safety area(s) is/are not consistent with the overall assessment" 
(doRule4) 

( saf ety_area 
(name ?sa) 

( numDe via t ions ?sd) ) 

( saf etyAreaAssessmentThreshold 
(threshold ?t) ) 

(test {>= ?sd ?t ) ) 

=> 

(assert (safety_area_not_consistent_with_overall_average ?sa) ) ) 



; If a safety area's average outcome is inconsistent with the overall 
; average outcome, then print to the screen, "Safety Area X is not 
consistent 

; with the overall assessment." 

/////////////////////////////////////////////////////////////////////// 

////// 



(def rule inconsistent_saf ety_area_action 

"Do this if a safety area is inconsistent with the overall average" 
( saf ety_area_not_consistent_with_overall_average ?sa) 

( saf ety_area 
(name ?sa) 

(avgWtdAnswer ?avg) ) 

=> 

(printout t "Safety Area " ?sa " is not consistent with the 
overall assessment." crlf) 

( ?*assessmentReport* addInconsistentArea ?sa ?avg) ) 



Rule 5 : 



If a particular response on a particular survey is unexpected, then 
print to the screen, "Question X from Survey Y contains an unexpected 
outcome . " 



(def rule quest ion_is_anomaly_rule 

"The response to this question is unexpected" 
(doRuleS ) 

( ou t c ome_i s_anoma ly 
(questionNumber ?q) 

( surveyNumber ? sn ) 
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( squadronNumber ?sqdrn) ) 

=> 

(printout t "Question " ?q " from Survey " ?sn ", Squadron " 
?sqdrn " contains an unexpected outcome." crlf ) ) 

(def rule interesting_question_anomalies_action 
(doRuleS) 

( interest ing_qu es t ion_anoma ly 
( quest ionNumber ?q) 

(frequency ?f ) ) 

(question 
(number ?q) 

(text ?txt) ) 

=> 

(printout t "Question " ?q " has " ?f " unexpected outcomes." crlf) 
( ?*integrityReport* addQuestionAnomaly ?q ?txt ?f ) ) 

(def rule interest ing_respondent_anomalies_action 
(doRuleS) 

( interesting_respondent_anomaly 
( surveyNumber ? svy ) 

( squadronNumber ?sqdrn) 

(frequency ?f ) ) 

=> 

(printout t "Survey " ?svy ", Squadron " ?sqdrn " contains " ?f " 
unexpected outcomes." crlf) 

( ?*integrityReport* a ddRespon dent Anomaly ?sqdrn ?svy ?f ) ) 



; Rule 6: Negative Question Assessment 

ittittittittiiifttttiffitftttitifttttfttti 



/ 

If 

to 


a question's average weighted 
the screen, "Question X has a 


answer is less than zero, 
negative assessment . " 


then print 


tilt 


' t t II t i t i t ! t ! t t t $ $ ! t t $ ! § i t II i ! t 


II iiiiiiiiiiiiiiiiiiiiiii 


tt9999t9tt9 



( def rule nega tive_question_assessment 

"The question has a negative weighted average" 
(doRuleS) 

(question 
(number ?n) 

(avgWtdAnswer ?a) 

(text ?txt) ) 

(test (< ?a 0) ) 

=> 



(printout t "Question 
crlf) 

( ?*assessmentReport* 



" ?n ", " ?txt ", has a negative assessment. 
addWeakQuestion ?n ?txt ?a) ) 



Actions 

ttittiftttfiititiittti ft] 
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{def rule display_assessment_report 
{declare (salience -100)) 

{display_assessment_report ) 

=> 

(call (fetch agentApp) display ?*assessmentReport*) ) 

(def rule email__assessment_report 
(declare (salience -100)) 

{email_assessinent_report (to $?toAddress) ) 

=> 

(call (fetch agentApp) mail ?*assessmentReport* $?toAddress) ) 

(defrule print_assessment_report 
(declare (salience -100)) 

(print_assessment_report ) 

=> 

(call (fetch agentApp) print ? *assessmentReport* ) ) 

(defrule display_integrity_report 
(declare (salience -100)) 

{ display_integri ty_report ) 

= > 

(call (fetch agentApp) display ?*integrityReport* ) ) 

( defrule emai l_in tegr i ty_repor t 
(declare (salience -100) ) 

(email_integrity_report (to $?toAddress) ) 

=> 

(call (fetch agentApp) mail ?*integrityReport* $?toAddress) ) 

(defrule print_integrity_report 
(declare (salience -100)) 

(print_integrity_report ) 

=> 

(call (fetch agentApp) print ? *integrityReport * ) ) 

(defrule save_assessment_report 
(declare (salience -100)) 

{ save_assessment_report ) 

=> 

(call (fetch agentApp) save ?*assessmentReport*) ) 

(defrule save_integrity_report 
(declare (salience -100) ) 

{ save_integri ty_report ) 

=> 

(call (fetch agentApp) save ?*integrityReport* ) ) 
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APPENDIX D. DATABASE SQL DDL 



-- BuildTables . sql 
-- Jan. 31, 2000 

-- Description: DDL for building Survey3_DB database tables. 
-- Rusl Flowers 



CREATE TABLE Communities 
(Community VARCHAR(25) , 

CONSTRAINT Communi ties_PK PRIMARY KEY (Community) ) 

CREATE TABLE Locations 
(Location VARCHAR(25) , 

CONSTRAINT Locations_PK PRIMARY KEY (Location)) 

CREATE TABLE Squadrons 
(Squadron_ID INT, 

Community VARCHAR(25) NOT NULL, 

Location VARCHAR(25) NOT NULL, 

CONSTRAINT Squadrons_PK PRIMARY KEY ( Squadron_ID) , 

CONSTRAINT Communi ty_FK FOREIGN KEY (Community ) REFERENCES Communities, 
CONSTRAINT Location_FK FOREIGN KEY ( Location) REFERENCES Locations) 

CREATE TABLE Squadrons_Su 2 Tvey_IDs 
(Survey_ID INT, 

Squadron_ID INT, 

CONSTRAINT Squadrons_Surveys_IDs_PK PRIMARY KEY 
(Survey_ID, Squadron_ID) , 

CONSTRAINT Squadron_ID_FK FOREIGN KEY ( Squadron_ID) REFERENCES 
Squadrons) 

CREATE TABLE Ranks 
(Rank VARCHAR(25) , 

CONSTRAINT Ranks_PK PRIMARY KEY (Rank)) 

CREATE TABLE Designators 
(Designator VARCHAR(25) , 

CONSTRAINT Designators_PK PRIMARY KEY (Designator) ) 

CREATE TABLE Status_Values 
(Status VARCHAR(25), 

CONSTRAINT S tatus_Values_PK PRIMARY KEY (Status)) 

CREATE TABLE Services 
(Service VARCHAR(25) , 

CONSTRAINT Services_PK PRIMARY KEY (Service)) 

CREATE TABLE Aircraf t_Types 
(Aircraft_Type VARCHAR(25) , 

CONSTRAINT Aircraf t_Types_PK PRIMARY KEY (Aircraf t_Type) ) 
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CREATE TABLE Respondents 
(Survey_ID INT, 

Sguadron_ID INT, 

Survey_Date DATE NOT NULL, 

Rank VARCHAR(25) NOT NULL, 

Designator VARCHAR(25) NOT NULL, 

Flight_Hours INT NOT NULL, 

Type_Hours INT NOT NULL, 

Dept_Head BIT NOT NULL, 

Status VARCHAR(25) NOT NULL, 

Service VARCHAR(25) NOT NULL, 

Aircraft_Type VARCHAR(25) NOT NULL, 

CONSTRAINT Respondents_PK PRIMARY KEY (Survey_ID, Sguadron_ID) , 
CONSTRAINT Resp_Survey_ID_FK FOREIGN KEY (Survey_ID, S<3uadron_ID) 
REFERENCES Squadrons_Survey_IDs , 

CONSTRAINT Rank_FK FOREIGN KEY (Rank) REFERENCES Ranks, 

CONSTRAINT Designator_FK FOREIGN KEY (Designator) REFERENCES 
Designators, 

CONSTRAINT Status_FK FOREIGN KEY (Status) REFERENCES Status_Values , 
CONSTRAINT Service_FK FOREIGN KEY (Service) REFERENCES Services, 
CONSTRAINT Aircraf t_Type_FK FOREIGN KEY (Aircraft_Type) REFERENCES 
Aircraft_Types) 

CREATE TABLE Safety_Areas 
(Safety_Area VARCHAR(50), 

CONSTRAINT Safety_Areas_PK PRIMARY KEY (Safety_Area) ) 

CREATE TABLE Questions 
(Question_ID INT, 

Question_Text VARCHAR(255) NOT NULL, 

Is_Positive BIT NOT NULL, 

Safety_Area VARCHAR(50) NOT NULL, 

CONSTRAINT Questions_PK PRIMARY KEY (Question_ID) , 

CONSTRAINT Safety_Area_FK FOREIGN KEY (Safety_Area) REFERENCES 
Saf ety_Areas ) 

CREATE TABLE Answers 
( Survey _ID INT, 

Sguadron_ID INT, 

Quest ion_ID INT, 

Answer INT NOT NULL, 

CONSTRAINT Answers_PK PRIMARY KEY (Survey_ID, Sguadron_ID, 
Question_ID) , 

CONSTRAINT Ans_Survey_ID_FK FOREIGN KEY (Survey_ID, Squadron_ID) 
REFERENCES Respondents , 

CONSTRAINT Ans_Question_ID_FK FOREIGN KEY (Question_ID) REFERENCES 
Questions ) 

CREATE TABLE Questionnaires 
(Questionnaire_Version INT, 

Last_Update DATE NOT NULL, 

CONSTRAINT Questionnaires_PK PRIMARY KEY (Questionnaire_Version) ) 
CREATE TABLE Questions_Questionnaires 
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(Questionnaire_Version INT, 

Quest ion_ID INT NOT NULL, 

Quest ion_Number INT NOT NULL, 

CONSTRAINT Questions_Questionnaires_PK PRIMARY KEY 
{Questionnaire_Version, Quest ion_ID) , 

CONSTRAINT QQ_Question_ID_FK FOREIGN KEY (Question_ID) REFERENCES 
Questions, 

CONSTRAINT QQ__Questionnaire_Version_FK FOREIGN KEY 
{ Ques t ionnai re_Ver si on ) REFERENCES Questionnaires ) 

-- end BuildTables . sql 
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